[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:03:12 dist-test-slave-w206 krb5kdc[22734](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:03:12 dist-test-slave-w206 krb5kdc[22734](info): set up 2 sockets
Aug 11 05:03:12 dist-test-slave-w206 krb5kdc[22734](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 05:03:13.972671 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.000s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:03:14 dist-test-slave-w206 krb5kdc[22734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:03:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:03:14.137809 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:33511
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:37827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:33511
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:14.294744 22748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:14.295352 22748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:14.295535 22748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:14.300334 22748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:14.300483 22748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:14.300522 22748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:14.300565 22748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:14.300599 22748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:03:14.306897 22748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:37827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:33511
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:33511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:14.309254 22748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:14.310767 22748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:14.325865 22753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:14.325865 22756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:14.325865 22754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:14.327021 22748 server_base.cc:1034] running on GCE node
I20260811 05:03:14.327950 22748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:14.329891 22748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:14.331120 22748 hybrid_clock.cc:648] HybridClock initialized: now 1786424594331065 us; error 76 us; skew 500 ppm
Aug 11 05:03:14 dist-test-slave-w206 krb5kdc[22734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424594, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:14.334565 22748 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:03:14.336138 22748 webserver.cc:460] Webserver started at http://127.22.49.254:39471/ using document root <none> and password file <none>
I20260811 05:03:14.337369 22748 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:14.337503 22748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:14.337937 22748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:14.341198 22748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "6473dedb18e94b26975e6cd3edd6e159"
format_stamp: "Formatted at 2026-08-11 05:03:14 on dist-test-slave-w206"
server_key: "351df199d1c873a44dd070dd45f13124"
server_key_iv: "f2c01c710693a3ecf01ed3e34290744a"
server_key_version: "encryptionkey@0"
I20260811 05:03:14.342236 22748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "6473dedb18e94b26975e6cd3edd6e159"
format_stamp: "Formatted at 2026-08-11 05:03:14 on dist-test-slave-w206"
server_key: "351df199d1c873a44dd070dd45f13124"
server_key_iv: "f2c01c710693a3ecf01ed3e34290744a"
server_key_version: "encryptionkey@0"
I20260811 05:03:14.348819 22748 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260811 05:03:14.353278 22763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:14.355515 22748 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 05:03:14.355803 22748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "6473dedb18e94b26975e6cd3edd6e159"
format_stamp: "Formatted at 2026-08-11 05:03:14 on dist-test-slave-w206"
server_key: "351df199d1c873a44dd070dd45f13124"
server_key_iv: "f2c01c710693a3ecf01ed3e34290744a"
server_key_version: "encryptionkey@0"
I20260811 05:03:14.355998 22748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:14.384479 22748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:14.389204 22748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:14.389518 22748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:14.400897 22748 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:33511
I20260811 05:03:14.400966 22819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:33511 every 8 connection(s)
I20260811 05:03:14.402449 22748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:14.407882 22820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:14.409782 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 22748
I20260811 05:03:14.410029 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:14.412262 22727 external_mini_cluster.cc:1428] Setting key 1f37dbb3fbe2598e67fa5af76fdb1b0e
I20260811 05:03:14.420550 22820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159: Bootstrap starting.
I20260811 05:03:14.425943 22820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:14.427330 22820 log.cc:824] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:14.431345 22820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159: No bootstrap required, opened a new log
I20260811 05:03:14.437839 22820 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6473dedb18e94b26975e6cd3edd6e159" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 33511 } }
I20260811 05:03:14.438346 22820 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:14.438452 22820 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6473dedb18e94b26975e6cd3edd6e159, State: Initialized, Role: FOLLOWER
I20260811 05:03:14.439548 22820 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6473dedb18e94b26975e6cd3edd6e159" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 33511 } }
I20260811 05:03:14.439853 22820 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:14.440044 22820 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:14.440222 22820 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 05:03:14 dist-test-slave-w206 krb5kdc[22734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:14.441530 22820 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6473dedb18e94b26975e6cd3edd6e159" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 33511 } }
I20260811 05:03:14.442199 22820 leader_election.cc:302] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6473dedb18e94b26975e6cd3edd6e159; no voters:
I20260811 05:03:14.442708 22820 leader_election.cc:288] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:14.442929 22825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:14.443203 22825 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [term 1 LEADER]: Becoming Leader. State: Replica: 6473dedb18e94b26975e6cd3edd6e159, State: Running, Role: LEADER
I20260811 05:03:14.443724 22825 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6473dedb18e94b26975e6cd3edd6e159" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 33511 } }
I20260811 05:03:14.444607 22820 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:14.447175 22826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6473dedb18e94b26975e6cd3edd6e159" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6473dedb18e94b26975e6cd3edd6e159" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 33511 } } }
I20260811 05:03:14.447381 22826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:14.447705 22827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6473dedb18e94b26975e6cd3edd6e159. Latest consensus state: current_term: 1 leader_uuid: "6473dedb18e94b26975e6cd3edd6e159" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6473dedb18e94b26975e6cd3edd6e159" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 33511 } } }
I20260811 05:03:14.448484 22827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:14.447948 22834 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:14.451153 22823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:14.420766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54938 (local address 127.22.49.254:33511)
0811 05:03:14.421278 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:14.421294 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:14.421372 (+ 78us) server_negotiation.cc:407] Connection header received
0811 05:03:14.426783 (+ 5411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:14.426803 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:14.427383 (+ 580us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:14.427756 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:14.431695 (+ 3939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:14.433149 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:14.435526 (+ 2377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:14.436116 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:14.436312 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:14.442297 (+ 5985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:14.442345 (+ 48us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:14.442360 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:14.442440 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:14.445282 (+ 2842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:14.446251 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:14.446258 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:14.446264 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:14.446444 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:14.446934 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:14.446937 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:14.446939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:14.447734 (+ 795us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:14.447978 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:14.449636 (+ 1658us) server_negotiation.cc:299] Negotiation successful
0811 05:03:14.450069 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":168,"threads_started":1}
I20260811 05:03:14.453763 22834 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:14.464088 22834 catalog_manager.cc:1347] Generated new cluster ID: 3ce8555c6845493b8dc049e37897bc65
I20260811 05:03:14.464190 22834 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:14.477397 22834 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:14.479019 22834 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:14.500821 22834 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6473dedb18e94b26975e6cd3edd6e159: Generated new TSK 0
I20260811 05:03:14.502184 22834 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:03:14.548070 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:33511
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:37827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:14.679193 22848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:14.679505 22848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:14.679553 22848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:14.683787 22848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:14.683863 22848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:14.683971 22848 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:03:14.689709 22848 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:37827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:33511
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:14.691018 22848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:14.692170 22848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:14.705574 22855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:14.705586 22854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:14.705663 22848 server_base.cc:1034] running on GCE node
W20260811 05:03:14.705629 22857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:14.706418 22848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:14.707290 22848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:14.708523 22848 hybrid_clock.cc:648] HybridClock initialized: now 1786424594708503 us; error 38 us; skew 500 ppm
Aug 11 05:03:14 dist-test-slave-w206 krb5kdc[22734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424594, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:14.712109 22848 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:03:14.713255 22848 webserver.cc:460] Webserver started at http://127.22.49.193:39381/ using document root <none> and password file <none>
I20260811 05:03:14.713922 22848 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:14.714033 22848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:14.714295 22848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:14.716694 22848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "d641e52610e544c8af87ecb769b1103e"
format_stamp: "Formatted at 2026-08-11 05:03:14 on dist-test-slave-w206"
server_key: "fbb1d1b1fa9679aa7dc13c2b04c4e4a8"
server_key_iv: "09e182ece0232bb31a1ad51aeaa651fd"
server_key_version: "encryptionkey@0"
I20260811 05:03:14.717336 22848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "d641e52610e544c8af87ecb769b1103e"
format_stamp: "Formatted at 2026-08-11 05:03:14 on dist-test-slave-w206"
server_key: "fbb1d1b1fa9679aa7dc13c2b04c4e4a8"
server_key_iv: "09e182ece0232bb31a1ad51aeaa651fd"
server_key_version: "encryptionkey@0"
I20260811 05:03:14.722141 22848 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 05:03:14.725167 22864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:14.726634 22848 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:14.726804 22848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "d641e52610e544c8af87ecb769b1103e"
format_stamp: "Formatted at 2026-08-11 05:03:14 on dist-test-slave-w206"
server_key: "fbb1d1b1fa9679aa7dc13c2b04c4e4a8"
server_key_iv: "09e182ece0232bb31a1ad51aeaa651fd"
server_key_version: "encryptionkey@0"
I20260811 05:03:14.726953 22848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:14.750716 22848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:14.754343 22848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:14.754683 22848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:14.755556 22848 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:14.756795 22848 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:14.756882 22848 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:14.756971 22848 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:14.757025 22848 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:14.769562 22848 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:40611
I20260811 05:03:14.769615 22985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:40611 every 8 connection(s)
I20260811 05:03:14.770676 22848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:03:14.777590 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 22848
I20260811 05:03:14.777770 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:03:14.778067 22727 external_mini_cluster.cc:1428] Setting key d19bfb9bd0bc538057eb16012eeece82
Aug 11 05:03:14 dist-test-slave-w206 krb5kdc[22734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424594, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:14.791700 22823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:14.773671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:57163 (local address 127.22.49.254:33511)
0811 05:03:14.773910 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:14.773918 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:14.774905 (+ 987us) server_negotiation.cc:407] Connection header received
0811 05:03:14.777160 (+ 2255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:14.777164 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:14.777277 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:14.777378 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:14.779053 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:14.779607 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:14.781719 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:14.781996 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:14.782102 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:14.786167 (+ 4065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:14.786175 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:14.786182 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:14.786226 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:14.788483 (+ 2257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:14.789459 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:14.789463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:14.789465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:14.789607 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:14.790139 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:14.790144 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:14.790148 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:14.790463 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:14.790589 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:14.791300 (+ 711us) server_negotiation.cc:299] Negotiation successful
0811 05:03:14.791492 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:03:14.792472 22988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:14.774119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:33511 (local address 127.22.49.193:57163)
0811 05:03:14.774686 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:14.774754 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:14.776813 (+ 2059us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:14.777591 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:14.777599 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:14.778136 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:14.778855 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:14.778876 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:14.779807 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:14.779810 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:14.781500 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:14.781523 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:14.782231 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:14.782239 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:14.782524 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:14.783611 (+ 1087us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:14.783631 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:14.785879 (+ 2248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:14.788800 (+ 2921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:14.788808 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:14.788826 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:14.789298 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:14.789749 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:14.789752 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:14.789753 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:14.790003 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:14.790605 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:14.790611 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:14.790932 (+ 321us) client_negotiation.cc:769] Sending connection context
0811 05:03:14.791195 (+ 263us) client_negotiation.cc:240] Negotiation successful
0811 05:03:14.791523 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":164,"threads_started":1}
I20260811 05:03:14.794497 22986 heartbeater.cc:347] Connected to a master server at 127.22.49.254:33511
I20260811 05:03:14.794880 22986 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:14.795656 22986 heartbeater.cc:511] Master 127.22.49.254:33511 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
I20260811 05:03:14.798925 22781 ts_manager.cc:194] Registered new tserver with Master: d641e52610e544c8af87ecb769b1103e (127.22.49.193:40611)
I20260811 05:03:14.801009 22781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:57163
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:03:14.821676 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:33511
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:37827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:14.953536 22991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:14.953936 22991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:14.954025 22991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:14.959098 22991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:14.959226 22991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:14.959336 22991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:03:14.967762 22991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:37827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:33511
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:14.969203 22991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:14.970414 22991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:14.988030 23001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:14.988019 22999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:14.988054 22998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:14.988921 22991 server_base.cc:1034] running on GCE node
I20260811 05:03:14.990099 22991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:14.991436 22991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:14.993221 22991 hybrid_clock.cc:648] HybridClock initialized: now 1786424594993177 us; error 76 us; skew 500 ppm
Aug 11 05:03:14 dist-test-slave-w206 krb5kdc[22734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424594, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:14.998556 22991 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:03:14.999912 22991 webserver.cc:460] Webserver started at http://127.22.49.194:40847/ using document root <none> and password file <none>
I20260811 05:03:15.000780 22991 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:15.000876 22991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:15.001179 22991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:15.004185 22991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "d2d60919e4b54c02932ebfda85a74806"
format_stamp: "Formatted at 2026-08-11 05:03:14 on dist-test-slave-w206"
server_key: "34000203aa46b2722ef2180b0414fd6d"
server_key_iv: "8253be2769100f208d5ca70513d25526"
server_key_version: "encryptionkey@0"
I20260811 05:03:15.005131 22991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "d2d60919e4b54c02932ebfda85a74806"
format_stamp: "Formatted at 2026-08-11 05:03:14 on dist-test-slave-w206"
server_key: "34000203aa46b2722ef2180b0414fd6d"
server_key_iv: "8253be2769100f208d5ca70513d25526"
server_key_version: "encryptionkey@0"
I20260811 05:03:15.011629 22991 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 05:03:15.016968 23010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:15.019922 22991 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.006s sys 0.000s
I20260811 05:03:15.020186 22991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "d2d60919e4b54c02932ebfda85a74806"
format_stamp: "Formatted at 2026-08-11 05:03:14 on dist-test-slave-w206"
server_key: "34000203aa46b2722ef2180b0414fd6d"
server_key_iv: "8253be2769100f208d5ca70513d25526"
server_key_version: "encryptionkey@0"
I20260811 05:03:15.020375 22991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:15.042956 22991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:15.049103 22991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:15.049398 22991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:15.050154 22991 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:15.051324 22991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:15.051416 22991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:15.051522 22991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:15.051564 22991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:15.063416 22991 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:45371
I20260811 05:03:15.063611 23132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:45371 every 8 connection(s)
I20260811 05:03:15.064527 22991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:03:15.072570 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 22991
I20260811 05:03:15.072727 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:03:15.073053 22727 external_mini_cluster.cc:1428] Setting key 1e2a2829806c985804d832212e3ed747
Aug 11 05:03:15 dist-test-slave-w206 krb5kdc[22734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424594, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:15.082334 22823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:15.066819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:37351 (local address 127.22.49.254:33511)
0811 05:03:15.067051 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:15.067056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:15.068068 (+ 1012us) server_negotiation.cc:407] Connection header received
0811 05:03:15.069534 (+ 1466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:15.069537 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:15.069595 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:15.069683 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:15.071138 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:15.071975 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:15.073481 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:15.073757 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:15.073863 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:15.077197 (+ 3334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:15.077206 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:15.077211 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:15.077263 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:15.079225 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:15.080095 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:15.080099 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:15.080100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:15.080199 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:15.080749 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:15.080752 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:15.080753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:15.081027 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:15.081123 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:15.082032 (+ 909us) server_negotiation.cc:299] Negotiation successful
0811 05:03:15.082177 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 05:03:15.083705 23135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:15.067345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:33511 (local address 127.22.49.194:37351)
0811 05:03:15.067873 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:15.067930 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:15.069258 (+ 1328us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:15.069877 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:15.069886 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:15.070370 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:15.070929 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:15.070945 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:15.072167 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:15.072171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:15.073325 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:15.073338 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:15.073966 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:15.073971 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:15.074166 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:15.075094 (+ 928us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:15.075117 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:15.076896 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:15.079421 (+ 2525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:15.079434 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:15.079459 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:15.079931 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:15.080311 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:15.080318 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:15.080323 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:15.080572 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:15.081163 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:15.081173 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:15.081642 (+ 469us) client_negotiation.cc:769] Sending connection context
0811 05:03:15.081915 (+ 273us) client_negotiation.cc:240] Negotiation successful
0811 05:03:15.082407 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":133,"threads_started":1}
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
I20260811 05:03:15.085286 23133 heartbeater.cc:347] Connected to a master server at 127.22.49.254:33511
I20260811 05:03:15.085592 23133 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:15.086216 23133 heartbeater.cc:511] Master 127.22.49.254:33511 requested a full tablet report, sending...
I20260811 05:03:15.087567 22781 ts_manager.cc:194] Registered new tserver with Master: d2d60919e4b54c02932ebfda85a74806 (127.22.49.194:45371)
I20260811 05:03:15.088218 22781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:37351
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:03:15.116053 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:33511
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:37827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:15.264647 23138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:15.265139 23138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:15.265202 23138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:15.269898 23138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:15.270018 23138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:15.270093 23138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:03:15.276962 23138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:37827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:33511
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:15.278636 23138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:15.280584 23138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:15.293236 23147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:15.293203 23144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:15.293341 23145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:15.293773 23138 server_base.cc:1034] running on GCE node
I20260811 05:03:15.294301 23138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:15.295195 23138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:15.296469 23138 hybrid_clock.cc:648] HybridClock initialized: now 1786424595296428 us; error 57 us; skew 500 ppm
Aug 11 05:03:15 dist-test-slave-w206 krb5kdc[22734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424595, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:15.300205 23138 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:03:15.301537 23138 webserver.cc:460] Webserver started at http://127.22.49.195:46285/ using document root <none> and password file <none>
I20260811 05:03:15.302233 23138 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:15.302349 23138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:15.302635 23138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:15.305245 23138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "26f0af9b96324c3eaca5a65855a09c77"
format_stamp: "Formatted at 2026-08-11 05:03:15 on dist-test-slave-w206"
server_key: "514fa5c5663a598f665324797e6f4f19"
server_key_iv: "e5a5707a790e8bf63926224cb28c93f2"
server_key_version: "encryptionkey@0"
I20260811 05:03:15.306078 23138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "26f0af9b96324c3eaca5a65855a09c77"
format_stamp: "Formatted at 2026-08-11 05:03:15 on dist-test-slave-w206"
server_key: "514fa5c5663a598f665324797e6f4f19"
server_key_iv: "e5a5707a790e8bf63926224cb28c93f2"
server_key_version: "encryptionkey@0"
I20260811 05:03:15.312196 23138 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 05:03:15.315850 23158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:15.317801 23138 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:03:15.317981 23138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "26f0af9b96324c3eaca5a65855a09c77"
format_stamp: "Formatted at 2026-08-11 05:03:15 on dist-test-slave-w206"
server_key: "514fa5c5663a598f665324797e6f4f19"
server_key_iv: "e5a5707a790e8bf63926224cb28c93f2"
server_key_version: "encryptionkey@0"
I20260811 05:03:15.318128 23138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:15.335141 23138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:15.340377 23138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:15.340600 23138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:15.341277 23138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:15.342357 23138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:15.342414 23138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:15.342464 23138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:15.342480 23138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:15.355978 23138 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:45449
I20260811 05:03:15.356000 23280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:45449 every 8 connection(s)
I20260811 05:03:15.357620 23138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:03:15.367506 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 23138
I20260811 05:03:15.367671 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:03:15.368029 22727 external_mini_cluster.cc:1428] Setting key 7b658fef4c1073a54c790e5354456533
Aug 11 05:03:15 dist-test-slave-w206 krb5kdc[22734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424595, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:15.379334 22823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:15.361262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:51075 (local address 127.22.49.254:33511)
0811 05:03:15.361450 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:15.361455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:15.363059 (+ 1604us) server_negotiation.cc:407] Connection header received
0811 05:03:15.364784 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:15.364787 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:15.364849 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:15.364958 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:15.366711 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:15.367612 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:15.369657 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:15.370011 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:15.370161 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:15.373948 (+ 3787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:15.373952 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:15.373954 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:15.373992 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:15.376006 (+ 2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:15.376762 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:15.376766 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:15.376768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:15.376885 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:15.377593 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:15.377599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:15.377601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:15.377856 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:15.378256 (+ 400us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:15.378936 (+ 680us) server_negotiation.cc:299] Negotiation successful
0811 05:03:15.379143 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 05:03:15.380309 23283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:15.361780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:33511 (local address 127.22.49.195:51075)
0811 05:03:15.362581 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:15.362646 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:15.364480 (+ 1834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:15.365228 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:15.365237 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:15.365874 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:15.366483 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:15.366500 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:15.367955 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:15.367959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:15.369284 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:15.369303 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:15.370244 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:15.370251 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:15.370545 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:15.371598 (+ 1053us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:15.371618 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:15.373669 (+ 2051us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:15.376203 (+ 2534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:15.376212 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:15.376244 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:15.376619 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:15.377000 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:15.377004 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:15.377006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:15.377286 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:15.378262 (+ 976us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:15.378274 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:15.378638 (+ 364us) client_negotiation.cc:769] Sending connection context
0811 05:03:15.378878 (+ 240us) client_negotiation.cc:240] Negotiation successful
0811 05:03:15.379319 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":182,"threads_started":1}
I20260811 05:03:15.381752 23281 heartbeater.cc:347] Connected to a master server at 127.22.49.254:33511
I20260811 05:03:15.382053 23281 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:15.382699 23281 heartbeater.cc:511] Master 127.22.49.254:33511 requested a full tablet report, sending...
I20260811 05:03:15.384163 22781 ts_manager.cc:194] Registered new tserver with Master: 26f0af9b96324c3eaca5a65855a09c77 (127.22.49.195:45449)
I20260811 05:03:15.384881 22781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:51075
I20260811 05:03:15.385075 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 05:03:15 dist-test-slave-w206 krb5kdc[22734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424595, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 05:03:15 dist-test-slave-w206 krb5kdc[22734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424595, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.49.193@KRBTEST.COM
I20260811 05:03:15.422664 23289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:15.409775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35722 (local address 127.22.49.193:40611)
0811 05:03:15.410187 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:15.410195 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:15.410228 (+ 33us) server_negotiation.cc:407] Connection header received
0811 05:03:15.410296 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:15.410303 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:15.410566 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:15.410741 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:15.411632 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:15.412895 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:15.413883 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:15.414522 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:15.414649 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:15.417666 (+ 3017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:15.417690 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:15.417710 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:15.417747 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:15.420240 (+ 2493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:15.420946 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:15.420954 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:15.420955 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:15.421072 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:15.421424 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:15.421427 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:15.421428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:15.421751 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:15.421968 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:15.422183 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 05:03:15.422400 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":141,"threads_started":1}
W20260811 05:03:15.424661 22895 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35722
Aug 11 05:03:15 dist-test-slave-w206 krb5kdc[22734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 05:03:15 dist-test-slave-w206 krb5kdc[22734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.193@KRBTEST.COM
I20260811 05:03:15.460935 23289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:15.448152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35726 (local address 127.22.49.193:40611)
0811 05:03:15.448437 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:15.448440 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:15.448464 (+ 24us) server_negotiation.cc:407] Connection header received
0811 05:03:15.448621 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:15.448624 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:15.448672 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:15.448755 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:15.449798 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:15.450746 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:15.452102 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:15.452451 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:15.452570 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:15.456425 (+ 3855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:15.456430 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:15.456432 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:15.456489 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:15.458360 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:15.459113 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:15.459116 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:15.459118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:15.459226 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:15.459645 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:15.459648 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:15.459649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:15.459898 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:15.460049 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:15.460551 (+ 502us) server_negotiation.cc:299] Negotiation successful
0811 05:03:15.460737 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169}
I20260811 05:03:15.462754 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 22848
I20260811 05:03:15.478111 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 22991
I20260811 05:03:15.491500 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 23138
I20260811 05:03:15.499850 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 22748
2026-08-11T05:03:15Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2747 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:03:15 dist-test-slave-w206 krb5kdc[23300](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:03:15 dist-test-slave-w206 krb5kdc[23300](info): set up 2 sockets
Aug 11 05:03:15 dist-test-slave-w206 krb5kdc[23300](info): commencing operation
krb5kdc: starting...
W20260811 05:03:16.676853 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:03:16 dist-test-slave-w206 krb5kdc[23300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:03:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:03:16.856635 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:40037
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:42343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:40037
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:17.006436 23313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:17.006839 23313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:17.006925 23313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:17.011502 23313 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:17.011644 23313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:17.011683 23313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:17.011725 23313 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:17.011765 23313 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:03:17.017982 23313 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:42343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:40037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:40037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:17.019471 23313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:17.020856 23313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:17.031659 23321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:17.031659 23319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:17.032006 23313 server_base.cc:1034] running on GCE node
W20260811 05:03:17.031874 23318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:17.032990 23313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:17.034379 23313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:17.037773 23313 hybrid_clock.cc:648] HybridClock initialized: now 1786424597037678 us; error 87 us; skew 500 ppm
Aug 11 05:03:17 dist-test-slave-w206 krb5kdc[23300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424597, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:17.043701 23313 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:03:17.044998 23313 webserver.cc:460] Webserver started at http://127.22.49.254:46645/ using document root <none> and password file <none>
I20260811 05:03:17.045719 23313 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:17.045841 23313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:17.046111 23313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:17.049132 23313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "ee6c5e69b66346888aa94d53fa9d80cc"
format_stamp: "Formatted at 2026-08-11 05:03:17 on dist-test-slave-w206"
server_key: "f01ec2baa566b10fa3e325fd52da41da"
server_key_iv: "45a5faa7757219401be67291eee25c5b"
server_key_version: "encryptionkey@0"
I20260811 05:03:17.049904 23313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "ee6c5e69b66346888aa94d53fa9d80cc"
format_stamp: "Formatted at 2026-08-11 05:03:17 on dist-test-slave-w206"
server_key: "f01ec2baa566b10fa3e325fd52da41da"
server_key_iv: "45a5faa7757219401be67291eee25c5b"
server_key_version: "encryptionkey@0"
I20260811 05:03:17.054836 23313 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260811 05:03:17.058569 23329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:17.061009 23313 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 05:03:17.061261 23313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "ee6c5e69b66346888aa94d53fa9d80cc"
format_stamp: "Formatted at 2026-08-11 05:03:17 on dist-test-slave-w206"
server_key: "f01ec2baa566b10fa3e325fd52da41da"
server_key_iv: "45a5faa7757219401be67291eee25c5b"
server_key_version: "encryptionkey@0"
I20260811 05:03:17.061475 23313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:17.086520 23313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:17.092365 23313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:17.092712 23313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:17.101485 23313 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:40037
I20260811 05:03:17.101511 23389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:40037 every 8 connection(s)
I20260811 05:03:17.102696 23313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:17.106148 23390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:17.107959 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 23313
I20260811 05:03:17.108117 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:17.108420 22727 external_mini_cluster.cc:1428] Setting key da34e8908f4c9b2589c90fd778f06bf0
I20260811 05:03:17.114538 23390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc: Bootstrap starting.
I20260811 05:03:17.117573 23390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:17.118708 23390 log.cc:824] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc: Log is configured to *not* fsync() on all Append() calls
Aug 11 05:03:17 dist-test-slave-w206 krb5kdc[23300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:17.123209 23390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc: No bootstrap required, opened a new log
I20260811 05:03:17.128898 23393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:17.110256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32910 (local address 127.22.49.254:40037)
0811 05:03:17.111317 (+ 1061us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:17.111340 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:17.111389 (+ 49us) server_negotiation.cc:407] Connection header received
0811 05:03:17.112150 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:17.112172 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:17.112606 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:17.113027 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:17.114227 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:17.115441 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:17.116434 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:17.117004 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:17.117206 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:17.121462 (+ 4256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:17.121470 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:17.121499 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:17.121537 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:17.123989 (+ 2452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:17.124775 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:17.124783 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:17.124789 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:17.124958 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:17.125365 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:17.125368 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:17.125369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:17.125950 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:17.126122 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:17.126622 (+ 500us) server_negotiation.cc:299] Negotiation successful
0811 05:03:17.127194 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":182,"threads_started":1}
I20260811 05:03:17.128770 23390 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6c5e69b66346888aa94d53fa9d80cc" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40037 } }
I20260811 05:03:17.129247 23390 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:17.129341 23390 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6c5e69b66346888aa94d53fa9d80cc, State: Initialized, Role: FOLLOWER
I20260811 05:03:17.130036 23390 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6c5e69b66346888aa94d53fa9d80cc" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40037 } }
I20260811 05:03:17.130231 23390 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:17.130327 23390 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:17.130472 23390 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:17.132054 23390 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6c5e69b66346888aa94d53fa9d80cc" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40037 } }
I20260811 05:03:17.132530 23390 leader_election.cc:302] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee6c5e69b66346888aa94d53fa9d80cc; no voters:
I20260811 05:03:17.133013 23390 leader_election.cc:288] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:17.133258 23395 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:17.133940 23395 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [term 1 LEADER]: Becoming Leader. State: Replica: ee6c5e69b66346888aa94d53fa9d80cc, State: Running, Role: LEADER
I20260811 05:03:17.134337 23395 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6c5e69b66346888aa94d53fa9d80cc" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40037 } }
I20260811 05:03:17.134795 23390 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:17.136555 23397 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee6c5e69b66346888aa94d53fa9d80cc. Latest consensus state: current_term: 1 leader_uuid: "ee6c5e69b66346888aa94d53fa9d80cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6c5e69b66346888aa94d53fa9d80cc" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40037 } } }
I20260811 05:03:17.136579 23396 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee6c5e69b66346888aa94d53fa9d80cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6c5e69b66346888aa94d53fa9d80cc" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40037 } } }
I20260811 05:03:17.136765 23396 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:17.136765 23397 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc [sys.catalog]: This master's current role is: LEADER
W20260811 05:03:17.141840 23411 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:03:17.141995 23411 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:03:17.142128 23405 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:17.143396 23405 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:17.151945 23405 catalog_manager.cc:1347] Generated new cluster ID: 36dff42f784b41ac8de6b88c7358eb61
I20260811 05:03:17.152062 23405 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:17.160709 23405 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:17.161899 23405 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:17.171875 23405 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee6c5e69b66346888aa94d53fa9d80cc: Generated new TSK 0
I20260811 05:03:17.172832 23405 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:03:17.220193 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40037
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:42343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:17.363827 23417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:17.364219 23417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:17.364310 23417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:17.369012 23417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:17.369148 23417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:17.369256 23417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:03:17.375507 23417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:42343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40037
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:17.376847 23417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:17.378050 23417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:17.389773 23425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:17.390036 23422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:17.389773 23423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:17.390511 23417 server_base.cc:1034] running on GCE node
I20260811 05:03:17.391548 23417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:17.392397 23417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:17.393627 23417 hybrid_clock.cc:648] HybridClock initialized: now 1786424597393601 us; error 44 us; skew 500 ppm
Aug 11 05:03:17 dist-test-slave-w206 krb5kdc[23300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424597, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:17.398207 23417 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:03:17.399633 23417 webserver.cc:460] Webserver started at http://127.22.49.193:45481/ using document root <none> and password file <none>
I20260811 05:03:17.400369 23417 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:17.400455 23417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:17.400671 23417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:17.403626 23417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "b0b9c157ed35433db2b8f46cd2b768e5"
format_stamp: "Formatted at 2026-08-11 05:03:17 on dist-test-slave-w206"
server_key: "29359cefa09f06a1165c39836704d010"
server_key_iv: "c1b65b4905973d1e86a97f103369583c"
server_key_version: "encryptionkey@0"
I20260811 05:03:17.404372 23417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "b0b9c157ed35433db2b8f46cd2b768e5"
format_stamp: "Formatted at 2026-08-11 05:03:17 on dist-test-slave-w206"
server_key: "29359cefa09f06a1165c39836704d010"
server_key_iv: "c1b65b4905973d1e86a97f103369583c"
server_key_version: "encryptionkey@0"
I20260811 05:03:17.410465 23417 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 05:03:17.414069 23433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:17.416092 23417 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 05:03:17.416247 23417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "b0b9c157ed35433db2b8f46cd2b768e5"
format_stamp: "Formatted at 2026-08-11 05:03:17 on dist-test-slave-w206"
server_key: "29359cefa09f06a1165c39836704d010"
server_key_iv: "c1b65b4905973d1e86a97f103369583c"
server_key_version: "encryptionkey@0"
I20260811 05:03:17.416452 23417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:17.432979 23417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:17.437716 23417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:17.437978 23417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:17.438776 23417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:17.439893 23417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:17.439985 23417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:17.440119 23417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:17.440160 23417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:17.454221 23417 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:36555
I20260811 05:03:17.454248 23559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:36555 every 8 connection(s)
I20260811 05:03:17.456146 23417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:03:17.462853 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 23417
I20260811 05:03:17.463038 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:03:17.463347 22727 external_mini_cluster.cc:1428] Setting key 031fb6c58ab52c8b3c7613a94d2efa3a
Aug 11 05:03:17 dist-test-slave-w206 krb5kdc[23300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424597, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:03:17.477299 23393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:17.459362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:60439 (local address 127.22.49.254:40037)
0811 05:03:17.459607 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:17.459612 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:17.461205 (+ 1593us) server_negotiation.cc:407] Connection header received
0811 05:03:17.462901 (+ 1696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:17.462906 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:17.463035 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:17.463147 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:17.465316 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:17.465946 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:17.468106 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:17.468620 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:17.468771 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:17.472215 (+ 3444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:17.472223 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:17.472229 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:17.472278 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:17.474193 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:17.475058 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:17.475064 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:17.475067 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:17.475176 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:17.475649 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:17.475654 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:17.475656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:17.475953 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:17.476078 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:17.476883 (+ 805us) server_negotiation.cc:299] Negotiation successful
0811 05:03:17.477071 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260811 05:03:17.478561 23562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:17.459866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:40037 (local address 127.22.49.193:60439)
0811 05:03:17.460957 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:17.461026 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:17.462595 (+ 1569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:17.463598 (+ 1003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:17.463624 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:17.464312 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:17.465078 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:17.465123 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:17.466120 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:17.466127 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:17.467890 (+ 1763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:17.467913 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:17.468863 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:17.468867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:17.469082 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:17.469967 (+ 885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:17.469988 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:17.471914 (+ 1926us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:17.474413 (+ 2499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:17.474421 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:17.474439 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:17.474842 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:17.475321 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:17.475324 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:17.475326 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:17.475514 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:17.476089 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:17.476096 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:17.476471 (+ 375us) client_negotiation.cc:769] Sending connection context
0811 05:03:17.476728 (+ 257us) client_negotiation.cc:240] Negotiation successful
0811 05:03:17.477301 (+ 573us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":818,"thread_start_us":265,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
I20260811 05:03:17.480654 23560 heartbeater.cc:347] Connected to a master server at 127.22.49.254:40037
I20260811 05:03:17.481063 23560 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:17.481760 23560 heartbeater.cc:511] Master 127.22.49.254:40037 requested a full tablet report, sending...
I20260811 05:03:17.484184 23348 ts_manager.cc:194] Registered new tserver with Master: b0b9c157ed35433db2b8f46cd2b768e5 (127.22.49.193:36555)
I20260811 05:03:17.485493 23348 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:60439
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:03:17.513033 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40037
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:42343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:17.653658 23566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:17.653990 23566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:17.654038 23566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:17.658596 23566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:17.658695 23566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:17.658761 23566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:03:17.664621 23566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:42343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40037
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:17.665871 23566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:17.667053 23566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:17.678838 23574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:17.678835 23571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:17.678844 23572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:17.679538 23566 server_base.cc:1034] running on GCE node
I20260811 05:03:17.680074 23566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:17.680828 23566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:17.682024 23566 hybrid_clock.cc:648] HybridClock initialized: now 1786424597682012 us; error 30 us; skew 500 ppm
Aug 11 05:03:17 dist-test-slave-w206 krb5kdc[23300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424597, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:17.692313 23566 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:03:17.694532 23566 webserver.cc:460] Webserver started at http://127.22.49.194:35519/ using document root <none> and password file <none>
I20260811 05:03:17.695509 23566 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:17.695649 23566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:17.695966 23566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:17.698791 23566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "a4ff5deb65074a45a50f0c4cbd5fb636"
format_stamp: "Formatted at 2026-08-11 05:03:17 on dist-test-slave-w206"
server_key: "22cd740fe09211c86fd6fed10e38adbc"
server_key_iv: "cf6589dda20aedd4d952dd8fdf969580"
server_key_version: "encryptionkey@0"
I20260811 05:03:17.699671 23566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "a4ff5deb65074a45a50f0c4cbd5fb636"
format_stamp: "Formatted at 2026-08-11 05:03:17 on dist-test-slave-w206"
server_key: "22cd740fe09211c86fd6fed10e38adbc"
server_key_iv: "cf6589dda20aedd4d952dd8fdf969580"
server_key_version: "encryptionkey@0"
I20260811 05:03:17.704478 23566 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:03:17.707823 23582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:17.709528 23566 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:03:17.709679 23566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "a4ff5deb65074a45a50f0c4cbd5fb636"
format_stamp: "Formatted at 2026-08-11 05:03:17 on dist-test-slave-w206"
server_key: "22cd740fe09211c86fd6fed10e38adbc"
server_key_iv: "cf6589dda20aedd4d952dd8fdf969580"
server_key_version: "encryptionkey@0"
I20260811 05:03:17.709810 23566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:17.736969 23566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:17.741626 23566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:17.741827 23566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:17.742501 23566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:17.743690 23566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:17.743749 23566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:17.743798 23566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:17.743813 23566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:17.754792 23708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:41405 every 8 connection(s)
I20260811 05:03:17.754801 23566 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:41405
I20260811 05:03:17.756080 23566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:03:17.765764 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 23566
I20260811 05:03:17.765928 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:03:17.766587 22727 external_mini_cluster.cc:1428] Setting key 08e75e25cab83be245fcd4fb24128796
Aug 11 05:03:17 dist-test-slave-w206 krb5kdc[23300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424597, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:17.776209 23393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:17.758626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:45813 (local address 127.22.49.254:40037)
0811 05:03:17.758814 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:17.758817 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:17.760168 (+ 1351us) server_negotiation.cc:407] Connection header received
0811 05:03:17.761933 (+ 1765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:17.761938 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:17.762015 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:17.762135 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:17.763723 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:17.764287 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:17.765816 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:17.766169 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:17.766287 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:17.771036 (+ 4749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:17.771041 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:17.771044 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:17.771086 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:17.772890 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:17.773798 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:17.773802 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:17.773803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:17.773924 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:17.774465 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:17.774468 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:17.774469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:17.774691 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:17.774777 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:17.775780 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0811 05:03:17.776047 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 05:03:17.777712 23711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:17.759124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:40037 (local address 127.22.49.194:45813)
0811 05:03:17.759827 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:17.759889 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:17.761588 (+ 1699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:17.762384 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:17.762394 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:17.762873 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:17.763511 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:17.763527 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:17.764465 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:17.764468 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:17.765606 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:17.765619 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:17.766393 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:17.766399 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:17.766691 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:17.768022 (+ 1331us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:17.768047 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:17.770718 (+ 2671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:17.773086 (+ 2368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:17.773097 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:17.773123 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:17.773617 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:17.774044 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:17.774050 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:17.774055 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:17.774302 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:17.774827 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:17.774840 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:17.775338 (+ 498us) client_negotiation.cc:769] Sending connection context
0811 05:03:17.775599 (+ 261us) client_negotiation.cc:240] Negotiation successful
0811 05:03:17.776091 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":204,"threads_started":1}
I20260811 05:03:17.779583 23709 heartbeater.cc:347] Connected to a master server at 127.22.49.254:40037
I20260811 05:03:17.779984 23709 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
I20260811 05:03:17.780786 23709 heartbeater.cc:511] Master 127.22.49.254:40037 requested a full tablet report, sending...
I20260811 05:03:17.782330 23348 ts_manager.cc:194] Registered new tserver with Master: a4ff5deb65074a45a50f0c4cbd5fb636 (127.22.49.194:41405)
I20260811 05:03:17.782949 23348 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:45813
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:03:17.808807 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40037
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:42343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:17.971920 23714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:17.972321 23714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:17.972415 23714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:17.977305 23714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:17.977469 23714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:17.977587 23714 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:03:17.985165 23714 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:42343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40037
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:17.986631 23714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:17.987912 23714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:18.000155 23719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:18.000540 23714 server_base.cc:1034] running on GCE node
W20260811 05:03:18.000157 23722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:18.000157 23720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:18.001127 23714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:18.001904 23714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:18.003122 23714 hybrid_clock.cc:648] HybridClock initialized: now 1786424598003080 us; error 58 us; skew 500 ppm
Aug 11 05:03:18 dist-test-slave-w206 krb5kdc[23300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424598, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:18.006671 23714 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:03:18.008056 23714 webserver.cc:460] Webserver started at http://127.22.49.195:35937/ using document root <none> and password file <none>
I20260811 05:03:18.008760 23714 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:18.008879 23714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:18.009184 23714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:18.011708 23714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "b84d347e977840a68c7623cb4d12a675"
format_stamp: "Formatted at 2026-08-11 05:03:18 on dist-test-slave-w206"
server_key: "fe1f8d62a2a884f096ac4c21d694a5d4"
server_key_iv: "8ff8c10df0f12d40dbd9d01ad73874d4"
server_key_version: "encryptionkey@0"
I20260811 05:03:18.012372 23714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "b84d347e977840a68c7623cb4d12a675"
format_stamp: "Formatted at 2026-08-11 05:03:18 on dist-test-slave-w206"
server_key: "fe1f8d62a2a884f096ac4c21d694a5d4"
server_key_iv: "8ff8c10df0f12d40dbd9d01ad73874d4"
server_key_version: "encryptionkey@0"
I20260811 05:03:18.016987 23714 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:03:18.020212 23729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:18.022039 23714 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:03:18.022269 23714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "b84d347e977840a68c7623cb4d12a675"
format_stamp: "Formatted at 2026-08-11 05:03:18 on dist-test-slave-w206"
server_key: "fe1f8d62a2a884f096ac4c21d694a5d4"
server_key_iv: "8ff8c10df0f12d40dbd9d01ad73874d4"
server_key_version: "encryptionkey@0"
I20260811 05:03:18.022454 23714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:18.045825 23714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:18.049741 23714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:18.050032 23714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:18.050707 23714 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:18.051697 23714 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:18.051745 23714 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:18.051824 23714 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:18.051863 23714 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:18.062834 23714 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:38561
I20260811 05:03:18.062863 23853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:38561 every 8 connection(s)
I20260811 05:03:18.064002 23714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:03:18.070523 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 23714
I20260811 05:03:18.070660 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:03:18.071103 22727 external_mini_cluster.cc:1428] Setting key d435a7488882aedabc86660bfcbe8ffe
Aug 11 05:03:18 dist-test-slave-w206 krb5kdc[23300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424598, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:18.081430 23393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.066295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:49059 (local address 127.22.49.254:40037)
0811 05:03:18.066555 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:18.066560 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:18.067697 (+ 1137us) server_negotiation.cc:407] Connection header received
0811 05:03:18.069172 (+ 1475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:18.069176 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:18.069238 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:18.069350 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:18.070963 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.071778 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.073346 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.073670 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.073820 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.077119 (+ 3299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:18.077126 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:18.077131 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:18.077174 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:18.078779 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:18.079518 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:18.079521 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:18.079522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:18.079624 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:18.080060 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:18.080063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:18.080064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:18.080300 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:18.080465 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:18.081155 (+ 690us) server_negotiation.cc:299] Negotiation successful
0811 05:03:18.081298 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 05:03:18.082314 23856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.066894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:40037 (local address 127.22.49.195:49059)
0811 05:03:18.067518 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:18.067566 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:18.068876 (+ 1310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:18.069570 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:18.069579 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:18.070057 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:18.070631 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:18.070656 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.071919 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.071923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:18.073200 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:18.073212 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.073861 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.073866 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:18.074086 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.074842 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:18.074866 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:18.076839 (+ 1973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:18.078966 (+ 2127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:18.079035 (+ 69us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:18.079060 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:18.079411 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:18.079719 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:18.079722 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:18.079723 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:18.079914 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:18.080466 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:18.080475 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:18.080863 (+ 388us) client_negotiation.cc:769] Sending connection context
0811 05:03:18.081049 (+ 186us) client_negotiation.cc:240] Negotiation successful
0811 05:03:18.081372 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":174,"threads_started":1}
I20260811 05:03:18.084200 23854 heartbeater.cc:347] Connected to a master server at 127.22.49.254:40037
I20260811 05:03:18.084556 23854 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:18.085263 23854 heartbeater.cc:511] Master 127.22.49.254:40037 requested a full tablet report, sending...
I20260811 05:03:18.086565 23348 ts_manager.cc:194] Registered new tserver with Master: b84d347e977840a68c7623cb4d12a675 (127.22.49.195:38561)
I20260811 05:03:18.087262 23348 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:49059
I20260811 05:03:18.098141 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:03:18.112869 23393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.103284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32920 (local address 127.22.49.254:40037)
0811 05:03:18.103489 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:18.103495 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:18.103688 (+ 193us) server_negotiation.cc:407] Connection header received
0811 05:03:18.103882 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:18.103885 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:18.103948 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:18.104051 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:18.104932 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.105534 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.106515 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.106794 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.106923 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.108790 (+ 1867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:18.108795 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:18.108798 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:18.108841 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:18.110646 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:18.111335 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:18.111339 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:18.111342 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:18.111459 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:18.111801 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:18.111805 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:18.111807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:18.112082 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:18.112252 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:18.112537 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 05:03:18.112678 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 05:03:18.120265 23348 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32920:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:03:18.124643 23348 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:18.146577 23865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.138939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:38561 (local address 127.0.0.1:60414)
0811 05:03:18.140290 (+ 1351us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:18.140304 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:18.140666 (+ 362us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:18.141584 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:18.141590 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:18.141616 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:18.141716 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:18.141723 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.143658 (+ 1935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.143662 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:18.144752 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:18.144760 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.146071 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.146075 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:18.146154 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.146176 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 05:03:18.146248 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 05:03:18.146400 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1285,"mutex_wait_us":4,"thread_start_us":755,"threads_started":1}
I20260811 05:03:18.146641 23866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.138084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:41405 (local address 127.0.0.1:40400)
0811 05:03:18.139066 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:18.139139 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:18.139327 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:18.141120 (+ 1793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:18.141123 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:18.141145 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:18.141303 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:18.141310 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.142910 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.142913 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:18.144359 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:18.144371 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.145860 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.145866 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:18.146037 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.146087 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 05:03:18.146230 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 05:03:18.146392 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":31,"thread_start_us":99,"threads_started":1}
I20260811 05:03:18.147217 23870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.138319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:36555 (local address 127.0.0.1:54340)
0811 05:03:18.139841 (+ 1522us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:18.139857 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:18.139951 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:18.140980 (+ 1029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:18.140991 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:18.141022 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:18.141210 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:18.141297 (+ 87us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.142651 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.142658 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:18.144169 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:18.144182 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.146264 (+ 2082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.146267 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:18.146376 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.146398 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 05:03:18.146467 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 05:03:18.146542 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1453,"mutex_wait_us":65,"thread_start_us":127,"threads_started":1}
I20260811 05:03:18.147374 23867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.138292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40400 (local address 127.22.49.194:41405)
0811 05:03:18.140272 (+ 1980us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:18.140292 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:18.140472 (+ 180us) server_negotiation.cc:407] Connection header received
0811 05:03:18.140576 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:18.140582 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:18.140927 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:18.141134 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:18.141564 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.142728 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.144527 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.145577 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.145733 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.145974 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:18.147080 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0811 05:03:18.147180 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1873,"thread_start_us":171,"threads_started":1}
I20260811 05:03:18.148320 23869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.139342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54340 (local address 127.22.49.193:36555)
0811 05:03:18.139880 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:18.139888 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:18.139986 (+ 98us) server_negotiation.cc:407] Connection header received
0811 05:03:18.140107 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:18.140117 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:18.140556 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:18.140736 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:18.141531 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.142478 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.144356 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.145577 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.145725 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.148033 (+ 2308us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:18.148095 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 05:03:18.148188 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":122,"threads_started":1}
I20260811 05:03:18.148679 23868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.139238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60414 (local address 127.22.49.195:38561)
0811 05:03:18.140148 (+ 910us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:18.140162 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:18.140624 (+ 462us) server_negotiation.cc:407] Connection header received
0811 05:03:18.141095 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:18.141103 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:18.141325 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:18.141585 (+ 260us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:18.141849 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.143477 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.144902 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.145878 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.146011 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.146172 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:18.146884 (+ 712us) server_negotiation.cc:299] Negotiation successful
0811 05:03:18.148491 (+ 1607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":780,"thread_start_us":186,"threads_started":1}
I20260811 05:03:18.152137 23634 tablet_service.cc:1467] Processing CreateTablet for tablet ae78a7c88cb44b5992fe35874a642640 (DEFAULT_TABLE table=test-table [id=957036fecb224ab58074d52e119d51fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:18.152201 23778 tablet_service.cc:1467] Processing CreateTablet for tablet ae78a7c88cb44b5992fe35874a642640 (DEFAULT_TABLE table=test-table [id=957036fecb224ab58074d52e119d51fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:18.152915 23486 tablet_service.cc:1467] Processing CreateTablet for tablet ae78a7c88cb44b5992fe35874a642640 (DEFAULT_TABLE table=test-table [id=957036fecb224ab58074d52e119d51fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:18.153795 23634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae78a7c88cb44b5992fe35874a642640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:18.153832 23486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae78a7c88cb44b5992fe35874a642640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:18.155560 23778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae78a7c88cb44b5992fe35874a642640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:18.161904 23871 tablet_bootstrap.cc:492] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636: Bootstrap starting.
I20260811 05:03:18.163879 23872 tablet_bootstrap.cc:492] T ae78a7c88cb44b5992fe35874a642640 P b0b9c157ed35433db2b8f46cd2b768e5: Bootstrap starting.
I20260811 05:03:18.165664 23873 tablet_bootstrap.cc:492] T ae78a7c88cb44b5992fe35874a642640 P b84d347e977840a68c7623cb4d12a675: Bootstrap starting.
I20260811 05:03:18.166716 23872 tablet_bootstrap.cc:654] T ae78a7c88cb44b5992fe35874a642640 P b0b9c157ed35433db2b8f46cd2b768e5: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:18.167683 23872 log.cc:824] T ae78a7c88cb44b5992fe35874a642640 P b0b9c157ed35433db2b8f46cd2b768e5: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:18.167711 23871 tablet_bootstrap.cc:654] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:18.168797 23873 tablet_bootstrap.cc:654] T ae78a7c88cb44b5992fe35874a642640 P b84d347e977840a68c7623cb4d12a675: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:18.168749 23871 log.cc:824] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:18.170389 23873 log.cc:824] T ae78a7c88cb44b5992fe35874a642640 P b84d347e977840a68c7623cb4d12a675: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:18.171093 23872 tablet_bootstrap.cc:492] T ae78a7c88cb44b5992fe35874a642640 P b0b9c157ed35433db2b8f46cd2b768e5: No bootstrap required, opened a new log
I20260811 05:03:18.171387 23872 ts_tablet_manager.cc:1397] T ae78a7c88cb44b5992fe35874a642640 P b0b9c157ed35433db2b8f46cd2b768e5: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260811 05:03:18.171415 23871 tablet_bootstrap.cc:492] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636: No bootstrap required, opened a new log
I20260811 05:03:18.171665 23871 ts_tablet_manager.cc:1397] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 05:03:18.172911 23873 tablet_bootstrap.cc:492] T ae78a7c88cb44b5992fe35874a642640 P b84d347e977840a68c7623cb4d12a675: No bootstrap required, opened a new log
I20260811 05:03:18.173161 23873 ts_tablet_manager.cc:1397] T ae78a7c88cb44b5992fe35874a642640 P b84d347e977840a68c7623cb4d12a675: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260811 05:03:18.176807 23872 raft_consensus.cc:348] T ae78a7c88cb44b5992fe35874a642640 P b0b9c157ed35433db2b8f46cd2b768e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4ff5deb65074a45a50f0c4cbd5fb636" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41405 } } peers { permanent_uuid: "b0b9c157ed35433db2b8f46cd2b768e5" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36555 } } peers { permanent_uuid: "b84d347e977840a68c7623cb4d12a675" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38561 } }
I20260811 05:03:18.177183 23872 raft_consensus.cc:374] T ae78a7c88cb44b5992fe35874a642640 P b0b9c157ed35433db2b8f46cd2b768e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:18.177248 23872 raft_consensus.cc:729] T ae78a7c88cb44b5992fe35874a642640 P b0b9c157ed35433db2b8f46cd2b768e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0b9c157ed35433db2b8f46cd2b768e5, State: Initialized, Role: FOLLOWER
I20260811 05:03:18.177102 23871 raft_consensus.cc:348] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4ff5deb65074a45a50f0c4cbd5fb636" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41405 } } peers { permanent_uuid: "b0b9c157ed35433db2b8f46cd2b768e5" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36555 } } peers { permanent_uuid: "b84d347e977840a68c7623cb4d12a675" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38561 } }
I20260811 05:03:18.177474 23871 raft_consensus.cc:374] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:18.177551 23871 raft_consensus.cc:729] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4ff5deb65074a45a50f0c4cbd5fb636, State: Initialized, Role: FOLLOWER
I20260811 05:03:18.177855 23872 consensus_queue.cc:260] T ae78a7c88cb44b5992fe35874a642640 P b0b9c157ed35433db2b8f46cd2b768e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4ff5deb65074a45a50f0c4cbd5fb636" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41405 } } peers { permanent_uuid: "b0b9c157ed35433db2b8f46cd2b768e5" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36555 } } peers { permanent_uuid: "b84d347e977840a68c7623cb4d12a675" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38561 } }
I20260811 05:03:18.178058 23871 consensus_queue.cc:260] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4ff5deb65074a45a50f0c4cbd5fb636" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41405 } } peers { permanent_uuid: "b0b9c157ed35433db2b8f46cd2b768e5" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36555 } } peers { permanent_uuid: "b84d347e977840a68c7623cb4d12a675" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38561 } }
I20260811 05:03:18.177910 23873 raft_consensus.cc:348] T ae78a7c88cb44b5992fe35874a642640 P b84d347e977840a68c7623cb4d12a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4ff5deb65074a45a50f0c4cbd5fb636" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41405 } } peers { permanent_uuid: "b0b9c157ed35433db2b8f46cd2b768e5" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36555 } } peers { permanent_uuid: "b84d347e977840a68c7623cb4d12a675" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38561 } }
I20260811 05:03:18.178331 23873 raft_consensus.cc:374] T ae78a7c88cb44b5992fe35874a642640 P b84d347e977840a68c7623cb4d12a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:18.178591 23873 raft_consensus.cc:729] T ae78a7c88cb44b5992fe35874a642640 P b84d347e977840a68c7623cb4d12a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b84d347e977840a68c7623cb4d12a675, State: Initialized, Role: FOLLOWER
I20260811 05:03:18.179315 23873 consensus_queue.cc:260] T ae78a7c88cb44b5992fe35874a642640 P b84d347e977840a68c7623cb4d12a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4ff5deb65074a45a50f0c4cbd5fb636" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41405 } } peers { permanent_uuid: "b0b9c157ed35433db2b8f46cd2b768e5" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36555 } } peers { permanent_uuid: "b84d347e977840a68c7623cb4d12a675" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38561 } }
I20260811 05:03:18.179396 23560 heartbeater.cc:503] Master 127.22.49.254:40037 was elected leader, sending a full tablet report...
I20260811 05:03:18.179656 23871 ts_tablet_manager.cc:1428] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260811 05:03:18.180513 23709 heartbeater.cc:503] Master 127.22.49.254:40037 was elected leader, sending a full tablet report...
I20260811 05:03:18.180513 23854 heartbeater.cc:503] Master 127.22.49.254:40037 was elected leader, sending a full tablet report...
I20260811 05:03:18.181722 23872 ts_tablet_manager.cc:1428] T ae78a7c88cb44b5992fe35874a642640 P b0b9c157ed35433db2b8f46cd2b768e5: Time spent starting tablet: real 0.010s user 0.006s sys 0.002s
I20260811 05:03:18.182554 23873 ts_tablet_manager.cc:1428] T ae78a7c88cb44b5992fe35874a642640 P b84d347e977840a68c7623cb4d12a675: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
W20260811 05:03:18.208611 23561 tablet.cc:2369] T ae78a7c88cb44b5992fe35874a642640 P b0b9c157ed35433db2b8f46cd2b768e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:03:18.257695 23710 tablet.cc:2369] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:03:18.315426 23855 tablet.cc:2369] T ae78a7c88cb44b5992fe35874a642640 P b84d347e977840a68c7623cb4d12a675: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:03:18.344374 23878 raft_consensus.cc:482] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:18.344708 23878 raft_consensus.cc:504] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4ff5deb65074a45a50f0c4cbd5fb636" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41405 } } peers { permanent_uuid: "b0b9c157ed35433db2b8f46cd2b768e5" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36555 } } peers { permanent_uuid: "b84d347e977840a68c7623cb4d12a675" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38561 } }
I20260811 05:03:18.346130 23878 leader_election.cc:288] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0b9c157ed35433db2b8f46cd2b768e5 (127.22.49.193:36555), b84d347e977840a68c7623cb4d12a675 (127.22.49.195:38561)
I20260811 05:03:18.350929 23869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.347254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:59719 (local address 127.22.49.193:36555)
0811 05:03:18.347434 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:18.347439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:18.347456 (+ 17us) server_negotiation.cc:407] Connection header received
0811 05:03:18.347523 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:18.347526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:18.347578 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:18.347672 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:18.348051 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.348581 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.349814 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.350276 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.350438 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.350503 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:18.350689 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 05:03:18.350774 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 05:03:18.351063 23881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.346599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:38561 (local address 127.22.49.194:55197)
0811 05:03:18.347107 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:18.347126 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:18.347314 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:18.347655 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:18.347658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:18.347676 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:18.347851 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:18.347858 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.348658 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.348661 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:18.349675 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:18.349686 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.350496 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.350500 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:18.350620 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.350642 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 05:03:18.350748 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 05:03:18.350830 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"mutex_wait_us":166,"thread_start_us":144,"threads_started":1}
I20260811 05:03:18.351050 23868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.346913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:55197 (local address 127.22.49.195:38561)
0811 05:03:18.347122 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:18.347127 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:18.347212 (+ 85us) server_negotiation.cc:407] Connection header received
0811 05:03:18.347483 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:18.347485 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:18.347530 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:18.347637 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:18.347986 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.348524 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.349827 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.350342 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.350504 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.350565 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:18.350769 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 05:03:18.350846 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260811 05:03:18.351353 23882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.346895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:36555 (local address 127.22.49.194:59719)
0811 05:03:18.347271 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:18.347284 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:18.347433 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:18.347699 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:18.347701 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:18.347719 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:18.347886 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:18.347927 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.348709 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.348714 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:18.349662 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:18.349673 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.350425 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.350429 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:18.350540 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.350569 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 05:03:18.350669 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 05:03:18.350759 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":22,"thread_start_us":137,"threads_started":1}
I20260811 05:03:18.351858 23800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae78a7c88cb44b5992fe35874a642640" candidate_uuid: "a4ff5deb65074a45a50f0c4cbd5fb636" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b84d347e977840a68c7623cb4d12a675" is_pre_election: true
I20260811 05:03:18.352080 23506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae78a7c88cb44b5992fe35874a642640" candidate_uuid: "a4ff5deb65074a45a50f0c4cbd5fb636" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0b9c157ed35433db2b8f46cd2b768e5" is_pre_election: true
I20260811 05:03:18.352348 23800 raft_consensus.cc:2454] T ae78a7c88cb44b5992fe35874a642640 P b84d347e977840a68c7623cb4d12a675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4ff5deb65074a45a50f0c4cbd5fb636 in term 0.
I20260811 05:03:18.352370 23506 raft_consensus.cc:2454] T ae78a7c88cb44b5992fe35874a642640 P b0b9c157ed35433db2b8f46cd2b768e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4ff5deb65074a45a50f0c4cbd5fb636 in term 0.
I20260811 05:03:18.352981 23587 leader_election.cc:302] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4ff5deb65074a45a50f0c4cbd5fb636, b0b9c157ed35433db2b8f46cd2b768e5; no voters:
I20260811 05:03:18.353343 23878 raft_consensus.cc:2781] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:18.353440 23878 raft_consensus.cc:482] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:18.353497 23878 raft_consensus.cc:3037] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:18.354708 23878 raft_consensus.cc:504] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4ff5deb65074a45a50f0c4cbd5fb636" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41405 } } peers { permanent_uuid: "b0b9c157ed35433db2b8f46cd2b768e5" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36555 } } peers { permanent_uuid: "b84d347e977840a68c7623cb4d12a675" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38561 } }
I20260811 05:03:18.355240 23878 leader_election.cc:288] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [CANDIDATE]: Term 1 election: Requested vote from peers b0b9c157ed35433db2b8f46cd2b768e5 (127.22.49.193:36555), b84d347e977840a68c7623cb4d12a675 (127.22.49.195:38561)
I20260811 05:03:18.355731 23800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae78a7c88cb44b5992fe35874a642640" candidate_uuid: "a4ff5deb65074a45a50f0c4cbd5fb636" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b84d347e977840a68c7623cb4d12a675"
I20260811 05:03:18.355785 23506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae78a7c88cb44b5992fe35874a642640" candidate_uuid: "a4ff5deb65074a45a50f0c4cbd5fb636" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0b9c157ed35433db2b8f46cd2b768e5"
I20260811 05:03:18.355875 23800 raft_consensus.cc:3037] T ae78a7c88cb44b5992fe35874a642640 P b84d347e977840a68c7623cb4d12a675 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:18.356045 23506 raft_consensus.cc:3037] T ae78a7c88cb44b5992fe35874a642640 P b0b9c157ed35433db2b8f46cd2b768e5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:18.357210 23800 raft_consensus.cc:2454] T ae78a7c88cb44b5992fe35874a642640 P b84d347e977840a68c7623cb4d12a675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4ff5deb65074a45a50f0c4cbd5fb636 in term 1.
I20260811 05:03:18.357347 23506 raft_consensus.cc:2454] T ae78a7c88cb44b5992fe35874a642640 P b0b9c157ed35433db2b8f46cd2b768e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4ff5deb65074a45a50f0c4cbd5fb636 in term 1.
I20260811 05:03:18.357625 23583 leader_election.cc:302] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4ff5deb65074a45a50f0c4cbd5fb636, b84d347e977840a68c7623cb4d12a675; no voters:
I20260811 05:03:18.357848 23878 raft_consensus.cc:2781] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:18.358151 23878 raft_consensus.cc:686] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [term 1 LEADER]: Becoming Leader. State: Replica: a4ff5deb65074a45a50f0c4cbd5fb636, State: Running, Role: LEADER
I20260811 05:03:18.358543 23878 consensus_queue.cc:237] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4ff5deb65074a45a50f0c4cbd5fb636" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41405 } } peers { permanent_uuid: "b0b9c157ed35433db2b8f46cd2b768e5" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36555 } } peers { permanent_uuid: "b84d347e977840a68c7623cb4d12a675" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38561 } }
I20260811 05:03:18.362844 23346 catalog_manager.cc:5495] T ae78a7c88cb44b5992fe35874a642640 P a4ff5deb65074a45a50f0c4cbd5fb636 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4ff5deb65074a45a50f0c4cbd5fb636 (127.22.49.194). New cstate: current_term: 1 leader_uuid: "a4ff5deb65074a45a50f0c4cbd5fb636" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4ff5deb65074a45a50f0c4cbd5fb636" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0b9c157ed35433db2b8f46cd2b768e5" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b84d347e977840a68c7623cb4d12a675" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38561 } health_report { overall_health: UNKNOWN } } }
Aug 11 05:03:18 dist-test-slave-w206 krb5kdc[23300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.193@KRBTEST.COM
I20260811 05:03:18.398537 23869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.387162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54350 (local address 127.22.49.193:36555)
0811 05:03:18.387317 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:18.387323 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:18.387594 (+ 271us) server_negotiation.cc:407] Connection header received
0811 05:03:18.387782 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:18.387788 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:18.387854 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:18.387964 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:18.388787 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.389438 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.390436 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.390706 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.390839 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.393985 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:18.394004 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:18.394024 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:18.394060 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:18.396349 (+ 2289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:18.396936 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:18.396942 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:18.396943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:18.397052 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:18.397323 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:18.397326 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:18.397327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:18.397627 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:18.397813 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:18.398114 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 05:03:18.398250 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 05:03:18 dist-test-slave-w206 krb5kdc[23300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424598, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 05:03:18 dist-test-slave-w206 krb5kdc[23300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424598, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.49.193@KRBTEST.COM
I20260811 05:03:18.436436 23869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.424714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54360 (local address 127.22.49.193:36555)
0811 05:03:18.424890 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:18.424895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:18.425084 (+ 189us) server_negotiation.cc:407] Connection header received
0811 05:03:18.425295 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:18.425298 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:18.425344 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:18.425439 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:18.426289 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.426897 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.428201 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.428470 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.428576 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.431909 (+ 3333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:18.431913 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:18.431915 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:18.431952 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:18.433843 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:18.434475 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:18.434487 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:18.434488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:18.434607 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:18.435089 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:18.435093 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:18.435094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:18.435460 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:18.435592 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:18.436065 (+ 473us) server_negotiation.cc:299] Negotiation successful
0811 05:03:18.436289 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
Aug 11 05:03:18 dist-test-slave-w206 krb5kdc[23300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 05:03:18 dist-test-slave-w206 krb5kdc[23300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.193@KRBTEST.COM
I20260811 05:03:18.471204 23869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:18.459741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54372 (local address 127.22.49.193:36555)
0811 05:03:18.459899 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:18.459923 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:18.460156 (+ 233us) server_negotiation.cc:407] Connection header received
0811 05:03:18.460303 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:18.460306 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:18.460362 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:18.460451 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:18.461300 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.462107 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.463323 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:18.463690 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:18.463794 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:18.467353 (+ 3559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:18.467358 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:18.467360 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:18.467399 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:18.469039 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:18.469641 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:18.469644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:18.469645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:18.469733 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:18.470038 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:18.470041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:18.470042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:18.470241 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:18.470395 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:18.470749 (+ 354us) server_negotiation.cc:299] Negotiation successful
0811 05:03:18.470879 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 05:03:18.473203 23463 tablet_service.cc:2908] Rejecting scan request for tablet ae78a7c88cb44b5992fe35874a642640: Uninitialized: clean time has not yet been initialized
I20260811 05:03:18.476070 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 23417
I20260811 05:03:18.486207 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 23566
I20260811 05:03:18.495774 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 23714
I20260811 05:03:18.507695 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 23313
2026-08-11T05:03:18Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (3008 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:03:18 dist-test-slave-w206 krb5kdc[23898](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:03:18 dist-test-slave-w206 krb5kdc[23898](info): set up 2 sockets
Aug 11 05:03:18 dist-test-slave-w206 krb5kdc[23898](info): commencing operation
krb5kdc: starting...
W20260811 05:03:19.709196 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.004s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:03:19 dist-test-slave-w206 krb5kdc[23898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:03:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:03:19.871529 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:32993
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:38421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:32993
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:20.016285 23912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:20.016717 23912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:20.016810 23912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:20.022082 23912 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:20.022353 23912 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 05:03:20.022799 23912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:20.022925 23912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:20.023015 23912 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:20.023061 23912 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:03:20.030376 23912 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:38421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:32993
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:32993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:20.031891 23912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:20.033131 23912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:20.044101 23918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:20.044101 23919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:20.044130 23921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:20.044468 23912 server_base.cc:1034] running on GCE node
I20260811 05:03:20.045258 23912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:20.046717 23912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:20.048101 23912 hybrid_clock.cc:648] HybridClock initialized: now 1786424600048060 us; error 66 us; skew 500 ppm
Aug 11 05:03:20 dist-test-slave-w206 krb5kdc[23898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424600, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:20.051935 23912 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:03:20.053319 23912 webserver.cc:460] Webserver started at http://127.22.49.254:38679/ using document root <none> and password file <none>
I20260811 05:03:20.054143 23912 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:20.054255 23912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:20.054507 23912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:20.057215 23912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "a785cb8c45594c2a9df4cf1cc93ee970"
format_stamp: "Formatted at 2026-08-11 05:03:20 on dist-test-slave-w206"
server_key: "a58f608f26bcea39e21c686a17175c61"
server_key_iv: "a417b223cf36e99a6aa4957bb7b0d568"
server_key_version: "encryptionkey@0"
I20260811 05:03:20.057919 23912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "a785cb8c45594c2a9df4cf1cc93ee970"
format_stamp: "Formatted at 2026-08-11 05:03:20 on dist-test-slave-w206"
server_key: "a58f608f26bcea39e21c686a17175c61"
server_key_iv: "a417b223cf36e99a6aa4957bb7b0d568"
server_key_version: "encryptionkey@0"
I20260811 05:03:20.062769 23912 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260811 05:03:20.065922 23928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:20.067812 23912 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:03:20.068058 23912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "a785cb8c45594c2a9df4cf1cc93ee970"
format_stamp: "Formatted at 2026-08-11 05:03:20 on dist-test-slave-w206"
server_key: "a58f608f26bcea39e21c686a17175c61"
server_key_iv: "a417b223cf36e99a6aa4957bb7b0d568"
server_key_version: "encryptionkey@0"
I20260811 05:03:20.068229 23912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:20.089764 23912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:20.093797 23912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:20.094107 23912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:20.103864 23912 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:32993
I20260811 05:03:20.103883 24000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:32993 every 8 connection(s)
I20260811 05:03:20.105036 23912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:20.108517 24001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:20.112627 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 23912
I20260811 05:03:20.112787 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:20.113122 22727 external_mini_cluster.cc:1428] Setting key 8fa54aa50c96c013c83642403d3d764b
I20260811 05:03:20.116647 24001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970: Bootstrap starting.
I20260811 05:03:20.119481 24001 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:20.120476 24001 log.cc:824] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:20.123699 24001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970: No bootstrap required, opened a new log
Aug 11 05:03:20 dist-test-slave-w206 krb5kdc[23898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:20.129053 24001 raft_consensus.cc:348] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a785cb8c45594c2a9df4cf1cc93ee970" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 32993 } }
I20260811 05:03:20.129459 24001 raft_consensus.cc:374] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:20.129522 24001 raft_consensus.cc:729] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a785cb8c45594c2a9df4cf1cc93ee970, State: Initialized, Role: FOLLOWER
I20260811 05:03:20.130138 24001 consensus_queue.cc:260] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a785cb8c45594c2a9df4cf1cc93ee970" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 32993 } }
I20260811 05:03:20.130342 24001 raft_consensus.cc:388] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:20.130421 24001 raft_consensus.cc:482] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:20.130534 24001 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:20.132308 24001 raft_consensus.cc:504] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a785cb8c45594c2a9df4cf1cc93ee970" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 32993 } }
I20260811 05:03:20.132815 24001 leader_election.cc:302] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a785cb8c45594c2a9df4cf1cc93ee970; no voters:
I20260811 05:03:20.133145 24004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:20.115122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54644 (local address 127.22.49.254:32993)
0811 05:03:20.115871 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:20.115926 (+ 55us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:20.115972 (+ 46us) server_negotiation.cc:407] Connection header received
0811 05:03:20.116732 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:20.116752 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:20.117249 (+ 497us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:20.117684 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:20.118737 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.120199 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.121593 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.122428 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.122647 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:20.125798 (+ 3151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:20.125806 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:20.125830 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:20.125878 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:20.128456 (+ 2578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:20.129274 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:20.129281 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:20.129288 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:20.129472 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:20.129895 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:20.129899 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:20.129901 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:20.130549 (+ 648us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:20.130825 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:20.131257 (+ 432us) server_negotiation.cc:299] Negotiation successful
0811 05:03:20.131654 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":200,"threads_started":1}
I20260811 05:03:20.133234 24001 leader_election.cc:288] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:20.133502 24006 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:20.133798 24006 raft_consensus.cc:686] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [term 1 LEADER]: Becoming Leader. State: Replica: a785cb8c45594c2a9df4cf1cc93ee970, State: Running, Role: LEADER
I20260811 05:03:20.134181 24006 consensus_queue.cc:237] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a785cb8c45594c2a9df4cf1cc93ee970" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 32993 } }
I20260811 05:03:20.134812 24001 sys_catalog.cc:564] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:20.136812 24008 sys_catalog.cc:455] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a785cb8c45594c2a9df4cf1cc93ee970. Latest consensus state: current_term: 1 leader_uuid: "a785cb8c45594c2a9df4cf1cc93ee970" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a785cb8c45594c2a9df4cf1cc93ee970" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 32993 } } }
I20260811 05:03:20.136821 24007 sys_catalog.cc:455] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a785cb8c45594c2a9df4cf1cc93ee970" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a785cb8c45594c2a9df4cf1cc93ee970" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 32993 } } }
I20260811 05:03:20.137010 24008 sys_catalog.cc:458] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:20.137008 24007 sys_catalog.cc:458] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:20.137656 24015 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:20.141031 24015 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:20.148566 24015 catalog_manager.cc:1347] Generated new cluster ID: 45affec121f64402a5928cab4e81eab9
I20260811 05:03:20.148684 24015 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:20.159672 24015 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:20.162773 24015 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:20.171694 24015 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970: Generated new TSK 0
I20260811 05:03:20.173290 24015 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:03:20.224656 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:32993
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:38421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:20.357131 24027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:20.357461 24027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:20.357509 24027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:20.361727 24027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:20.361811 24027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:20.361853 24027 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:03:20.361887 24027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:03:20.367537 24027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:38421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.49.254:32993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:20.368670 24027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:20.369700 24027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:20.380285 24034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:20.380277 24033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:20.380299 24036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:20.380712 24027 server_base.cc:1034] running on GCE node
I20260811 05:03:20.381152 24027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:20.381927 24027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:20.383117 24027 hybrid_clock.cc:648] HybridClock initialized: now 1786424600383104 us; error 35 us; skew 500 ppm
Aug 11 05:03:20 dist-test-slave-w206 krb5kdc[23898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424600, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:20.386111 24027 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:03:20.387272 24027 webserver.cc:460] Webserver started at http://127.22.49.193:44531/ using document root <none> and password file <none>
I20260811 05:03:20.387888 24027 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:20.387961 24027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:20.388196 24027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:20.390367 24027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "72beb8a856764e32ab84d5cbaf605955"
format_stamp: "Formatted at 2026-08-11 05:03:20 on dist-test-slave-w206"
server_key: "6996ecb0977bf897430f913dece62c1c"
server_key_iv: "9c92e612f2a806bafbda8739e6689a74"
server_key_version: "encryptionkey@0"
I20260811 05:03:20.391075 24027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "72beb8a856764e32ab84d5cbaf605955"
format_stamp: "Formatted at 2026-08-11 05:03:20 on dist-test-slave-w206"
server_key: "6996ecb0977bf897430f913dece62c1c"
server_key_iv: "9c92e612f2a806bafbda8739e6689a74"
server_key_version: "encryptionkey@0"
I20260811 05:03:20.395470 24027 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 05:03:20.398116 24043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:20.399523 24027 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:03:20.399672 24027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "72beb8a856764e32ab84d5cbaf605955"
format_stamp: "Formatted at 2026-08-11 05:03:20 on dist-test-slave-w206"
server_key: "6996ecb0977bf897430f913dece62c1c"
server_key_iv: "9c92e612f2a806bafbda8739e6689a74"
server_key_version: "encryptionkey@0"
I20260811 05:03:20.399797 24027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:20.430778 24027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:20.434887 24027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:20.435209 24027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:20.436883 24027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:20.436936 24027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:20.437003 24027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:20.437036 24027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 05:03:20 dist-test-slave-w206 krb5kdc[23898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424600, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:20.448875 24027 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:43769
I20260811 05:03:20.449146 24167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:43769 every 8 connection(s)
I20260811 05:03:20.450174 24027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:03:20.452754 24004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:20.438017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:48437 (local address 127.22.49.254:32993)
0811 05:03:20.438160 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:20.438164 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:20.439385 (+ 1221us) server_negotiation.cc:407] Connection header received
0811 05:03:20.440714 (+ 1329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:20.440718 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:20.440782 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:20.440929 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:20.442741 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.443495 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.444947 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.445185 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.445302 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:20.448451 (+ 3149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:20.448455 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:20.448458 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:20.448498 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:20.450228 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:20.450936 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:20.450942 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:20.450945 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:20.451081 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:20.451583 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:20.451588 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:20.451589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:20.451802 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:20.451925 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:20.452436 (+ 511us) server_negotiation.cc:299] Negotiation successful
0811 05:03:20.452575 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 05:03:20.453536 24052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:20.438615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:32993 (local address 127.22.49.193:48437)
0811 05:03:20.439188 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:20.439235 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:20.440471 (+ 1236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:20.441166 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:20.441178 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:20.441757 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:20.442570 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:20.442594 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.443636 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.443640 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:20.444809 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:20.444819 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.445364 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.445368 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:20.445543 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:20.446203 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:20.446221 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:20.448205 (+ 1984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:20.450391 (+ 2186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:20.450397 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:20.450412 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:20.450795 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:20.451344 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:20.451346 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:20.451348 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:20.451478 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:20.451923 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:20.451930 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:20.452184 (+ 254us) client_negotiation.cc:769] Sending connection context
0811 05:03:20.452381 (+ 197us) client_negotiation.cc:240] Negotiation successful
0811 05:03:20.452707 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":138,"threads_started":1}
I20260811 05:03:20.454175 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 24027
I20260811 05:03:20.454299 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:03:20.454639 22727 external_mini_cluster.cc:1428] Setting key 43bcc69abd51d2bd6925bb17c6cc0636
I20260811 05:03:20.455184 24168 heartbeater.cc:347] Connected to a master server at 127.22.49.254:32993
I20260811 05:03:20.455367 24168 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:20.455966 24168 heartbeater.cc:511] Master 127.22.49.254:32993 requested a full tablet report, sending...
I20260811 05:03:20.457719 23945 ts_manager.cc:194] Registered new tserver with Master: 72beb8a856764e32ab84d5cbaf605955 (127.22.49.193:43769)
I20260811 05:03:20.458916 23945 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:48437
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:03:20.467314 24004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:20.459139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:36195 (local address 127.22.49.254:32993)
0811 05:03:20.459649 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:20.459654 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:20.459671 (+ 17us) server_negotiation.cc:407] Connection header received
0811 05:03:20.459710 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:20.459712 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:20.459759 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:20.459853 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:20.460371 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.460881 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.461724 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.461952 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.462061 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:20.463539 (+ 1478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:20.463542 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:20.463544 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:20.463578 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:20.465170 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:20.465782 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:20.465785 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:20.465786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:20.465868 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:20.466246 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:20.466249 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:20.466250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:20.466515 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:20.466609 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:20.467038 (+ 429us) server_negotiation.cc:299] Negotiation successful
0811 05:03:20.467186 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433}
I20260811 05:03:20.467375 24176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:20.457451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:32993 (local address 127.22.49.193:36195)
0811 05:03:20.457781 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:20.457798 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:20.457906 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:20.459883 (+ 1977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:20.459887 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:20.460130 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:20.460236 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:20.460242 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.461016 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.461019 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:20.461589 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:20.461597 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.462069 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.462072 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:20.462167 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:20.462929 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:20.462947 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:20.463365 (+ 418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:20.465332 (+ 1967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:20.465338 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:20.465341 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:20.465654 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:20.465974 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:20.465979 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:20.465983 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:20.466086 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:20.466639 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:20.466644 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:20.466787 (+ 143us) client_negotiation.cc:769] Sending connection context
0811 05:03:20.466921 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 05:03:20.467128 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":116,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:03:20.491124 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:32993
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:38421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:20.621493 24179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:20.621939 24179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:20.622053 24179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:20.627197 24179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:20.627332 24179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:20.627416 24179 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:03:20.627499 24179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:03:20.634006 24179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:38421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.49.254:32993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:20.635526 24179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:20.636852 24179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:20.649288 24187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:20.649288 24184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:20.649452 24179 server_base.cc:1034] running on GCE node
W20260811 05:03:20.649382 24185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:20.650183 24179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:20.651086 24179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:20.652357 24179 hybrid_clock.cc:648] HybridClock initialized: now 1786424600652335 us; error 39 us; skew 500 ppm
Aug 11 05:03:20 dist-test-slave-w206 krb5kdc[23898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424600, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:20.656303 24179 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:03:20.657431 24179 webserver.cc:460] Webserver started at http://127.22.49.194:44731/ using document root <none> and password file <none>
I20260811 05:03:20.658057 24179 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:20.658128 24179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:20.658321 24179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:20.661371 24179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "0e18da5280db4fc7b68b57f3b6980f55"
format_stamp: "Formatted at 2026-08-11 05:03:20 on dist-test-slave-w206"
server_key: "17a031c5c4abef073d0599da01f7326a"
server_key_iv: "a5ed0d09b7fdbf3c36daa7ccc1c9a287"
server_key_version: "encryptionkey@0"
I20260811 05:03:20.662091 24179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "0e18da5280db4fc7b68b57f3b6980f55"
format_stamp: "Formatted at 2026-08-11 05:03:20 on dist-test-slave-w206"
server_key: "17a031c5c4abef073d0599da01f7326a"
server_key_iv: "a5ed0d09b7fdbf3c36daa7ccc1c9a287"
server_key_version: "encryptionkey@0"
I20260811 05:03:20.667101 24179 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 05:03:20.670455 24194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:20.672289 24179 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:03:20.672482 24179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "0e18da5280db4fc7b68b57f3b6980f55"
format_stamp: "Formatted at 2026-08-11 05:03:20 on dist-test-slave-w206"
server_key: "17a031c5c4abef073d0599da01f7326a"
server_key_iv: "a5ed0d09b7fdbf3c36daa7ccc1c9a287"
server_key_version: "encryptionkey@0"
I20260811 05:03:20.672632 24179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:20.691540 24179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:20.696096 24179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:20.696306 24179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:20.697991 24179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:20.698057 24179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:20.698105 24179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:20.698173 24179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 05:03:20 dist-test-slave-w206 krb5kdc[23898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424600, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:20.713569 24179 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:45389
I20260811 05:03:20.714010 24321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:45389 every 8 connection(s)
I20260811 05:03:20.714710 24179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:03:20.717478 24004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:20.699376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:39187 (local address 127.22.49.254:32993)
0811 05:03:20.699566 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:20.699570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:20.701015 (+ 1445us) server_negotiation.cc:407] Connection header received
0811 05:03:20.702487 (+ 1472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:20.702491 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:20.702563 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:20.702667 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:20.705207 (+ 2540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.706820 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.708738 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.709019 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.709153 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:20.712569 (+ 3416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:20.712573 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:20.712575 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:20.712611 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:20.714578 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:20.715413 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:20.715417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:20.715419 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:20.715541 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:20.716038 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:20.716042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:20.716044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:20.716390 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:20.716490 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:20.717154 (+ 664us) server_negotiation.cc:299] Negotiation successful
0811 05:03:20.717298 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 05:03:20.718298 24204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:20.700090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:32993 (local address 127.22.49.194:39187)
0811 05:03:20.700790 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:20.700844 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:20.702188 (+ 1344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:20.702926 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:20.702937 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:20.703761 (+ 824us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:20.704903 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:20.704935 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.707193 (+ 2258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.707197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:20.708526 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:20.708543 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.709234 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.709239 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:20.709460 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:20.710308 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:20.710328 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:20.712297 (+ 1969us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:20.714744 (+ 2447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:20.714750 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:20.714767 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:20.715230 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:20.715691 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:20.715695 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:20.715697 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:20.715892 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:20.716521 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:20.716527 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:20.716808 (+ 281us) client_negotiation.cc:769] Sending connection context
0811 05:03:20.717020 (+ 212us) client_negotiation.cc:240] Negotiation successful
0811 05:03:20.717333 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":212,"threads_started":1}
I20260811 05:03:20.720355 24322 heartbeater.cc:347] Connected to a master server at 127.22.49.254:32993
I20260811 05:03:20.720628 24322 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:20.720630 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 24179
I20260811 05:03:20.720736 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:03:20.721101 22727 external_mini_cluster.cc:1428] Setting key 3d8a1befee81c52d172fb3f02bdd1840
I20260811 05:03:20.721331 24322 heartbeater.cc:511] Master 127.22.49.254:32993 requested a full tablet report, sending...
I20260811 05:03:20.722654 23946 ts_manager.cc:194] Registered new tserver with Master: 0e18da5280db4fc7b68b57f3b6980f55 (127.22.49.194:45389)
I20260811 05:03:20.723496 23946 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:39187
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
I20260811 05:03:20.735829 24004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:20.723503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:36783 (local address 127.22.49.254:32993)
0811 05:03:20.723656 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:20.723661 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:20.724445 (+ 784us) server_negotiation.cc:407] Connection header received
0811 05:03:20.724623 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:20.724626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:20.724678 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:20.724770 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:20.725528 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.726396 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.727892 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.728419 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.728533 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:20.730365 (+ 1832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:20.730371 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:20.730377 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:20.730421 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:20.733159 (+ 2738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:20.733868 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:20.733877 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:20.733878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:20.734003 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:20.734385 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:20.734389 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:20.734391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:20.734835 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:20.734972 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:20.735449 (+ 477us) server_negotiation.cc:299] Negotiation successful
0811 05:03:20.735581 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 05:03:20.735981 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:20.723672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:32993 (local address 127.22.49.194:36783)
0811 05:03:20.724270 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:20.724336 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:20.724501 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:20.724848 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:20.724854 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:20.725164 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:20.725352 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:20.725366 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.726589 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.726593 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:20.727710 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:20.727740 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.728598 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.728605 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:20.728755 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:20.729556 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:20.729570 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:20.729998 (+ 428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:20.733432 (+ 3434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:20.733437 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:20.733438 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:20.733716 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:20.734151 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:20.734155 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:20.734156 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:20.734261 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:20.735052 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:20.735057 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:20.735182 (+ 125us) client_negotiation.cc:769] Sending connection context
0811 05:03:20.735353 (+ 171us) client_negotiation.cc:240] Negotiation successful
0811 05:03:20.735543 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":141,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:03:20.760114 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:32993
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:38421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:20.883160 24332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:20.883630 24332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:20.883728 24332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:20.888303 24332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:20.888420 24332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:20.888496 24332 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:03:20.888571 24332 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:03:20.894414 24332 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:38421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.49.254:32993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:20.895780 24332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:20.896946 24332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:20.908285 24337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:20.908322 24340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:20.908490 24332 server_base.cc:1034] running on GCE node
W20260811 05:03:20.908739 24338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:20.909227 24332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:20.909991 24332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:20.913350 24332 hybrid_clock.cc:648] HybridClock initialized: now 1786424600913306 us; error 82 us; skew 500 ppm
Aug 11 05:03:20 dist-test-slave-w206 krb5kdc[23898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424600, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:20.916919 24332 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:03:20.918092 24332 webserver.cc:460] Webserver started at http://127.22.49.195:37575/ using document root <none> and password file <none>
I20260811 05:03:20.918694 24332 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:20.918759 24332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:20.918944 24332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:20.921420 24332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "900a9d7a920d4b1db1b8667ad0a0840c"
format_stamp: "Formatted at 2026-08-11 05:03:20 on dist-test-slave-w206"
server_key: "b4862d15807cae926aa4d3774f101074"
server_key_iv: "fe985811dfc3e78cc38394ba3994845a"
server_key_version: "encryptionkey@0"
I20260811 05:03:20.921988 24332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "900a9d7a920d4b1db1b8667ad0a0840c"
format_stamp: "Formatted at 2026-08-11 05:03:20 on dist-test-slave-w206"
server_key: "b4862d15807cae926aa4d3774f101074"
server_key_iv: "fe985811dfc3e78cc38394ba3994845a"
server_key_version: "encryptionkey@0"
I20260811 05:03:20.926075 24332 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260811 05:03:20.928907 24348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:20.930294 24332 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:20.930442 24332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "900a9d7a920d4b1db1b8667ad0a0840c"
format_stamp: "Formatted at 2026-08-11 05:03:20 on dist-test-slave-w206"
server_key: "b4862d15807cae926aa4d3774f101074"
server_key_iv: "fe985811dfc3e78cc38394ba3994845a"
server_key_version: "encryptionkey@0"
I20260811 05:03:20.930605 24332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:20.956676 24332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:20.960531 24332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:20.960774 24332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:20.962342 24332 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:20.962445 24332 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:20.962513 24332 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:20.962548 24332 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 05:03:20 dist-test-slave-w206 krb5kdc[23898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424600, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:20.974293 24332 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:42607
I20260811 05:03:20.974334 24476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:42607 every 8 connection(s)
I20260811 05:03:20.975438 24332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:03:20.979182 24004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:20.963541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:44275 (local address 127.22.49.254:32993)
0811 05:03:20.963693 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:20.963697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:20.964861 (+ 1164us) server_negotiation.cc:407] Connection header received
0811 05:03:20.966176 (+ 1315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:20.966182 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:20.966251 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:20.966342 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:20.968300 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.969036 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.971011 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.971284 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.971374 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:20.974843 (+ 3469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:20.974847 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:20.974850 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:20.974888 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:20.976679 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:20.977304 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:20.977310 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:20.977315 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:20.977451 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:20.977842 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:20.977845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:20.977846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:20.978116 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:20.978234 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:20.978779 (+ 545us) server_negotiation.cc:299] Negotiation successful
0811 05:03:20.978962 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 05:03:20.979161 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 24332
I20260811 05:03:20.979297 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:03:20.979610 22727 external_mini_cluster.cc:1428] Setting key 9eac073faa5684b8408ef95d653a3a5e
I20260811 05:03:20.980167 24357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:20.964120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:32993 (local address 127.22.49.195:44275)
0811 05:03:20.964691 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:20.964740 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:20.965862 (+ 1122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:20.966813 (+ 951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:20.966820 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:20.967387 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:20.968071 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:20.968097 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.969178 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.969185 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:20.970836 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:20.970851 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.971476 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.971483 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:20.971710 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:20.972510 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:20.972539 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:20.974633 (+ 2094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:20.976810 (+ 2177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:20.976816 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:20.976837 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:20.977194 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:20.977551 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:20.977553 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:20.977555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:20.977708 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:20.978237 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:20.978242 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:20.978525 (+ 283us) client_negotiation.cc:769] Sending connection context
0811 05:03:20.978706 (+ 181us) client_negotiation.cc:240] Negotiation successful
0811 05:03:20.979116 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":137,"threads_started":1}
I20260811 05:03:20.981422 24478 heartbeater.cc:347] Connected to a master server at 127.22.49.254:32993
I20260811 05:03:20.981573 24478 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:20.982187 24478 heartbeater.cc:511] Master 127.22.49.254:32993 requested a full tablet report, sending...
I20260811 05:03:20.983255 23945 ts_manager.cc:194] Registered new tserver with Master: 900a9d7a920d4b1db1b8667ad0a0840c (127.22.49.195:42607)
I20260811 05:03:20.983991 23945 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:44275
I20260811 05:03:20.992640 24004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:20.984522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:38129 (local address 127.22.49.254:32993)
0811 05:03:20.984645 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:20.984649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:20.984661 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:03:20.984768 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:20.984771 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:20.984817 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:20.984906 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:20.985625 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.986362 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.987280 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.987506 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.987591 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:20.989204 (+ 1613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:20.989207 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:20.989209 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:20.989234 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:20.990869 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:20.991378 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:20.991380 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:20.991381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:20.991460 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:20.991720 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:20.991723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:20.991724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:20.991918 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:20.991998 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:20.992359 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 05:03:20.992486 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 05:03:20.992686 24484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:20.984171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:32993 (local address 127.22.49.195:38129)
0811 05:03:20.984543 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:20.984560 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:20.984662 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:20.984970 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:20.984973 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:20.985373 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:20.985489 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:20.985496 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.986500 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.986503 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:20.987172 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:20.987182 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:20.987621 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:20.987624 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:20.987696 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:20.988495 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:20.988611 (+ 116us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:20.989035 (+ 424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:20.991074 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:20.991077 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:20.991079 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:20.991285 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:20.991556 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:20.991558 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:20.991560 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:20.991637 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:20.992034 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:20.992036 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:20.992133 (+ 97us) client_negotiation.cc:769] Sending connection context
0811 05:03:20.992233 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 05:03:20.992462 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":125,"threads_started":1}
I20260811 05:03:20.994239 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 05:03:21 dist-test-slave-w206 krb5kdc[23898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424601, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 05:03:21 dist-test-slave-w206 krb5kdc[23898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424601, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:21.024339 24004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.014646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54646 (local address 127.22.49.254:32993)
0811 05:03:21.014817 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:21.014821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:21.014837 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:03:21.014886 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:21.014889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:21.014936 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:21.015111 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:21.015915 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.016454 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.017325 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.017561 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.017642 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.020689 (+ 3047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:21.020696 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:21.020701 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:21.020742 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:21.022470 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:21.023029 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:21.023037 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:21.023038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:21.023121 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:21.023491 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:21.023494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:21.023495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:21.023705 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:21.023838 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:21.024075 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 05:03:21.024198 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 05:03:21.028582 23946 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54646:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:03:21.032123 23946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:21.049932 24497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.043200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55498 (local address 127.22.49.193:43769)
0811 05:03:21.043626 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:21.043635 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:21.044026 (+ 391us) server_negotiation.cc:407] Connection header received
0811 05:03:21.044405 (+ 379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:21.044413 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:21.044669 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:21.044855 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:21.045152 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.046480 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.048028 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.048979 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.049132 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.049320 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:21.049638 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 05:03:21.049765 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":92,"threads_started":1}
I20260811 05:03:21.049945 24496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.043025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:43769 (local address 127.0.0.1:55498)
0811 05:03:21.043886 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:21.043942 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:21.044141 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:21.044831 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:21.044836 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:21.044858 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:21.045015 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.045023 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.046632 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.046636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.047889 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.047900 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.049139 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.049146 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.049375 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.049444 (+ 69us) client_negotiation.cc:769] Sending connection context
0811 05:03:21.049573 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 05:03:21.049762 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"mutex_wait_us":58,"thread_start_us":108,"threads_started":1}
I20260811 05:03:21.049985 24501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.044307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60584 (local address 127.22.49.194:45389)
0811 05:03:21.044704 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:21.044719 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:21.044744 (+ 25us) server_negotiation.cc:407] Connection header received
0811 05:03:21.044823 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:21.044828 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:21.045014 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:21.045165 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:21.045472 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.046359 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.048199 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.049060 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.049167 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.049335 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:21.049733 (+ 398us) server_negotiation.cc:299] Negotiation successful
0811 05:03:21.049823 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":170,"threads_started":1}
I20260811 05:03:21.049945 24498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.043562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:42607 (local address 127.0.0.1:45276)
0811 05:03:21.044287 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:21.044301 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:21.044387 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:21.045593 (+ 1206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:21.045595 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:21.045613 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:21.045712 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.045718 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.047273 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.047276 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.048334 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.048343 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.049172 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.049175 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.049380 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.049671 (+ 291us) client_negotiation.cc:769] Sending connection context
0811 05:03:21.049736 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 05:03:21.049790 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"mutex_wait_us":280,"thread_start_us":105,"threads_started":1}
I20260811 05:03:21.050638 24500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.043811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:45389 (local address 127.0.0.1:60584)
0811 05:03:21.044588 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:21.044601 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:21.044677 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:21.045270 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:21.045273 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:21.045286 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:21.045353 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.045357 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.046497 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.046503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.048061 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.048072 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.049410 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.049414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.049506 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.049527 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 05:03:21.049636 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 05:03:21.050487 (+ 851us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"mutex_wait_us":806,"thread_start_us":109,"threads_started":1}
I20260811 05:03:21.050788 24499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.043760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45276 (local address 127.22.49.195:42607)
0811 05:03:21.044843 (+ 1083us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:21.044856 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:21.045171 (+ 315us) server_negotiation.cc:407] Connection header received
0811 05:03:21.045255 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:21.045261 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:21.045448 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:21.045611 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:21.045842 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.047116 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.048452 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.049015 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.049455 (+ 440us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.049630 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:21.050497 (+ 867us) server_negotiation.cc:299] Negotiation successful
0811 05:03:21.050626 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":970,"thread_start_us":132,"threads_started":1}
I20260811 05:03:21.053460 24095 tablet_service.cc:1467] Processing CreateTablet for tablet 2c5c65217cc74d22b87c653bd2ce5464 (DEFAULT_TABLE table=test-table [id=76cd6f50279d4cf4b9c3896300d77a8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:21.053711 24247 tablet_service.cc:1467] Processing CreateTablet for tablet 2c5c65217cc74d22b87c653bd2ce5464 (DEFAULT_TABLE table=test-table [id=76cd6f50279d4cf4b9c3896300d77a8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:21.053711 24401 tablet_service.cc:1467] Processing CreateTablet for tablet 2c5c65217cc74d22b87c653bd2ce5464 (DEFAULT_TABLE table=test-table [id=76cd6f50279d4cf4b9c3896300d77a8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:21.054796 24095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c5c65217cc74d22b87c653bd2ce5464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:21.055022 24247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c5c65217cc74d22b87c653bd2ce5464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:21.055073 24401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c5c65217cc74d22b87c653bd2ce5464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:21.063511 24502 tablet_bootstrap.cc:492] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955: Bootstrap starting.
I20260811 05:03:21.065665 24504 tablet_bootstrap.cc:492] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55: Bootstrap starting.
I20260811 05:03:21.066136 24503 tablet_bootstrap.cc:492] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c: Bootstrap starting.
I20260811 05:03:21.066587 24502 tablet_bootstrap.cc:654] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:21.067515 24502 log.cc:824] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:21.068375 24504 tablet_bootstrap.cc:654] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:21.068377 24503 tablet_bootstrap.cc:654] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:21.069417 24504 log.cc:824] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:21.069417 24503 log.cc:824] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:21.069695 24502 tablet_bootstrap.cc:492] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955: No bootstrap required, opened a new log
I20260811 05:03:21.069976 24502 ts_tablet_manager.cc:1397] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 05:03:21.072105 24503 tablet_bootstrap.cc:492] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c: No bootstrap required, opened a new log
I20260811 05:03:21.072105 24504 tablet_bootstrap.cc:492] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55: No bootstrap required, opened a new log
I20260811 05:03:21.072358 24503 ts_tablet_manager.cc:1397] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 05:03:21.072525 24504 ts_tablet_manager.cc:1397] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 05:03:21.074301 24502 raft_consensus.cc:348] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.074647 24502 raft_consensus.cc:374] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:21.074709 24502 raft_consensus.cc:729] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72beb8a856764e32ab84d5cbaf605955, State: Initialized, Role: FOLLOWER
I20260811 05:03:21.075301 24502 consensus_queue.cc:260] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.076094 24168 heartbeater.cc:503] Master 127.22.49.254:32993 was elected leader, sending a full tablet report...
I20260811 05:03:21.076525 24502 ts_tablet_manager.cc:1428] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 05:03:21.077148 24504 raft_consensus.cc:348] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.077148 24503 raft_consensus.cc:348] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.077522 24503 raft_consensus.cc:374] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:21.077522 24504 raft_consensus.cc:374] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:21.077598 24504 raft_consensus.cc:729] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e18da5280db4fc7b68b57f3b6980f55, State: Initialized, Role: FOLLOWER
I20260811 05:03:21.077598 24503 raft_consensus.cc:729] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 900a9d7a920d4b1db1b8667ad0a0840c, State: Initialized, Role: FOLLOWER
I20260811 05:03:21.078146 24503 consensus_queue.cc:260] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.078146 24504 consensus_queue.cc:260] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.079023 24478 heartbeater.cc:503] Master 127.22.49.254:32993 was elected leader, sending a full tablet report...
I20260811 05:03:21.079448 24504 ts_tablet_manager.cc:1428] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 05:03:21.079448 24503 ts_tablet_manager.cc:1428] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 05:03:21.080176 24322 heartbeater.cc:503] Master 127.22.49.254:32993 was elected leader, sending a full tablet report...
W20260811 05:03:21.201804 24169 tablet.cc:2369] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:03:21.216580 24323 tablet.cc:2369] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:03:21.226775 24479 tablet.cc:2369] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:03:21.266873 24510 raft_consensus.cc:482] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:21.267234 24510 raft_consensus.cc:504] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.268594 24510 leader_election.cc:288] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72beb8a856764e32ab84d5cbaf605955 (127.22.49.193:43769), 900a9d7a920d4b1db1b8667ad0a0840c (127.22.49.195:42607)
I20260811 05:03:21.272953 24499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.269022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:57097 (local address 127.22.49.195:42607)
0811 05:03:21.269198 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:21.269203 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:21.269324 (+ 121us) server_negotiation.cc:407] Connection header received
0811 05:03:21.269510 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:21.269513 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:21.269565 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:21.269662 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:21.269992 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.270536 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.271805 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.272237 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.272381 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.272443 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:21.272708 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 05:03:21.272787 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 05:03:21.272943 24497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.269105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:56523 (local address 127.22.49.193:43769)
0811 05:03:21.269309 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:21.269317 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:21.269394 (+ 77us) server_negotiation.cc:407] Connection header received
0811 05:03:21.269563 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:21.269566 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:21.269620 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:21.269713 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:21.270022 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.270541 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.271804 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.272250 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.272389 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.272443 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:21.272698 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 05:03:21.272782 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 05:03:21.273012 24511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.268866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:43769 (local address 127.22.49.194:56523)
0811 05:03:21.269287 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:21.269303 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:21.269454 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:21.269727 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:21.269736 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:21.269779 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:21.269906 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.269912 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.270674 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.270680 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.271651 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.271663 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.272389 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.272393 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.272524 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.272544 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 05:03:21.272679 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 05:03:21.272779 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"mutex_wait_us":7,"spinlock_wait_cycles":2432,"thread_start_us":74,"threads_started":1}
I20260811 05:03:21.273029 24512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.268856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:42607 (local address 127.22.49.194:57097)
0811 05:03:21.269208 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:21.269225 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:21.269392 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:21.269679 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:21.269689 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:21.269708 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:21.269869 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.269875 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.270671 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.270675 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.271661 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.271672 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.272379 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.272383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.272559 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.272596 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 05:03:21.272689 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 05:03:21.272774 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":113,"spinlock_wait_cycles":2304,"thread_start_us":98,"threads_started":1}
I20260811 05:03:21.274220 24423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5c65217cc74d22b87c653bd2ce5464" candidate_uuid: "0e18da5280db4fc7b68b57f3b6980f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" is_pre_election: true
I20260811 05:03:21.274224 24110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5c65217cc74d22b87c653bd2ce5464" candidate_uuid: "0e18da5280db4fc7b68b57f3b6980f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72beb8a856764e32ab84d5cbaf605955" is_pre_election: true
I20260811 05:03:21.274576 24423 raft_consensus.cc:2454] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e18da5280db4fc7b68b57f3b6980f55 in term 0.
I20260811 05:03:21.274585 24110 raft_consensus.cc:2454] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e18da5280db4fc7b68b57f3b6980f55 in term 0.
I20260811 05:03:21.275174 24199 leader_election.cc:302] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0e18da5280db4fc7b68b57f3b6980f55, 72beb8a856764e32ab84d5cbaf605955, 900a9d7a920d4b1db1b8667ad0a0840c; no voters:
I20260811 05:03:21.275534 24510 raft_consensus.cc:2781] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:21.275626 24510 raft_consensus.cc:482] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:21.275660 24510 raft_consensus.cc:3037] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:21.276903 24510 raft_consensus.cc:504] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.277407 24510 leader_election.cc:288] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [CANDIDATE]: Term 1 election: Requested vote from peers 72beb8a856764e32ab84d5cbaf605955 (127.22.49.193:43769), 900a9d7a920d4b1db1b8667ad0a0840c (127.22.49.195:42607)
I20260811 05:03:21.278029 24110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5c65217cc74d22b87c653bd2ce5464" candidate_uuid: "0e18da5280db4fc7b68b57f3b6980f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72beb8a856764e32ab84d5cbaf605955"
I20260811 05:03:21.278151 24423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c5c65217cc74d22b87c653bd2ce5464" candidate_uuid: "0e18da5280db4fc7b68b57f3b6980f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "900a9d7a920d4b1db1b8667ad0a0840c"
I20260811 05:03:21.278205 24110 raft_consensus.cc:3037] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:21.278328 24423 raft_consensus.cc:3037] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:21.279548 24110 raft_consensus.cc:2454] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e18da5280db4fc7b68b57f3b6980f55 in term 1.
I20260811 05:03:21.280030 24199 leader_election.cc:302] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e18da5280db4fc7b68b57f3b6980f55, 72beb8a856764e32ab84d5cbaf605955; no voters:
I20260811 05:03:21.280234 24510 raft_consensus.cc:2781] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:21.280483 24510 raft_consensus.cc:686] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [term 1 LEADER]: Becoming Leader. State: Replica: 0e18da5280db4fc7b68b57f3b6980f55, State: Running, Role: LEADER
I20260811 05:03:21.280536 24423 raft_consensus.cc:2454] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e18da5280db4fc7b68b57f3b6980f55 in term 1.
I20260811 05:03:21.280902 24510 consensus_queue.cc:237] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.284605 23945 catalog_manager.cc:5495] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e18da5280db4fc7b68b57f3b6980f55 (127.22.49.194). New cstate: current_term: 1 leader_uuid: "0e18da5280db4fc7b68b57f3b6980f55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } health_report { overall_health: UNKNOWN } } }
I20260811 05:03:21.354703 24501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.350833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60586 (local address 127.22.49.194:45389)
0811 05:03:21.350992 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:21.350996 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:21.351012 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:03:21.351234 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:21.351237 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:21.351335 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:21.351437 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:21.351726 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.352231 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.353072 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.353276 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.353356 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.353752 (+ 396us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:21.354190 (+ 438us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:21.354281 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:21.354445 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 05:03:21.354507 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 05:03:21.362094 24110 raft_consensus.cc:1261] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955 [term 1 FOLLOWER]: Refusing update from remote peer 0e18da5280db4fc7b68b57f3b6980f55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:21.363070 24513 consensus_queue.cc:1035] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:21.363464 24423 raft_consensus.cc:1261] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c [term 1 FOLLOWER]: Refusing update from remote peer 0e18da5280db4fc7b68b57f3b6980f55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:21.364068 24513 consensus_queue.cc:1035] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:21.371973 24518 mvcc.cc:205] Tried to move back new op lower bound from 7317195167169204224 to 7317195166849605632. Current Snapshot: MvccSnapshot[applied={T|T < 7317195167169204224}]
I20260811 05:03:21.373463 24517 mvcc.cc:205] Tried to move back new op lower bound from 7317195167169204224 to 7317195166849605632. Current Snapshot: MvccSnapshot[applied={T|T < 7317195167169204224}]
I20260811 05:03:21.385805 23946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:21.386103 23946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:21.389313 23946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970: Sending DeleteTablet for 3 replicas of tablet 2c5c65217cc74d22b87c653bd2ce5464
I20260811 05:03:21.390342 24401 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c5c65217cc74d22b87c653bd2ce5464 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:21 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:45276
I20260811 05:03:21.390499 24095 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c5c65217cc74d22b87c653bd2ce5464 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:21 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:55498
I20260811 05:03:21.390588 24247 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c5c65217cc74d22b87c653bd2ce5464 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:21 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:60584
I20260811 05:03:21.391029 24526 tablet_replica.cc:330] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c: stopping tablet replica
I20260811 05:03:21.391395 24526 raft_consensus.cc:2229] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:21.391745 24526 raft_consensus.cc:2258] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:21.391806 24528 tablet_replica.cc:330] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55: stopping tablet replica
I20260811 05:03:21.392081 23946 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54646:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 05:03:21.392365 24527 tablet_replica.cc:330] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955: stopping tablet replica
W20260811 05:03:21.392577 23946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:21.392693 24528 raft_consensus.cc:2229] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:03:21.393090 24528 raft_consensus.cc:2258] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:21.394229 24526 ts_tablet_manager.cc:1905] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:21.394613 24528 ts_tablet_manager.cc:1905] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:21.397390 24526 ts_tablet_manager.cc:1918] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:21.397503 24526 log.cc:1196] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/2c5c65217cc74d22b87c653bd2ce5464
I20260811 05:03:21.397874 24526 ts_tablet_manager.cc:1939] T 2c5c65217cc74d22b87c653bd2ce5464 P 900a9d7a920d4b1db1b8667ad0a0840c: Deleting consensus metadata
I20260811 05:03:21.399116 24528 ts_tablet_manager.cc:1918] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:21.399156 24247 tablet_service.cc:1467] Processing CreateTablet for tablet f60d1745686a409cac9f5bdd6355a94f (DEFAULT_TABLE table=test-table [id=0f9077ea61b2485ba1b7f9c257dedea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:21.399479 24247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f60d1745686a409cac9f5bdd6355a94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:21.399497 24527 raft_consensus.cc:2229] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:21.399672 24095 tablet_service.cc:1467] Processing CreateTablet for tablet f60d1745686a409cac9f5bdd6355a94f (DEFAULT_TABLE table=test-table [id=0f9077ea61b2485ba1b7f9c257dedea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:21.399827 24527 raft_consensus.cc:2258] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:21.399959 24095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f60d1745686a409cac9f5bdd6355a94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:21.400416 24528 log.cc:1196] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/2c5c65217cc74d22b87c653bd2ce5464
I20260811 05:03:21.400794 24528 ts_tablet_manager.cc:1939] T 2c5c65217cc74d22b87c653bd2ce5464 P 0e18da5280db4fc7b68b57f3b6980f55: Deleting consensus metadata
I20260811 05:03:21.401939 24504 tablet_bootstrap.cc:492] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55: Bootstrap starting.
I20260811 05:03:21.402498 24502 tablet_bootstrap.cc:492] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955: Bootstrap starting.
I20260811 05:03:21.402872 23930 catalog_manager.cc:4841] TS 900a9d7a920d4b1db1b8667ad0a0840c (127.22.49.195:42607): tablet 2c5c65217cc74d22b87c653bd2ce5464 (table test-table [id=76cd6f50279d4cf4b9c3896300d77a8a]) successfully deleted
I20260811 05:03:21.403061 24504 tablet_bootstrap.cc:654] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:21.403187 24401 tablet_service.cc:1467] Processing CreateTablet for tablet f60d1745686a409cac9f5bdd6355a94f (DEFAULT_TABLE table=test-table [id=0f9077ea61b2485ba1b7f9c257dedea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:21.403421 23932 catalog_manager.cc:4841] TS 0e18da5280db4fc7b68b57f3b6980f55 (127.22.49.194:45389): tablet 2c5c65217cc74d22b87c653bd2ce5464 (table test-table [id=76cd6f50279d4cf4b9c3896300d77a8a]) successfully deleted
I20260811 05:03:21.403491 24401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f60d1745686a409cac9f5bdd6355a94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:21.403697 24502 tablet_bootstrap.cc:654] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:21.404690 24504 tablet_bootstrap.cc:492] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55: No bootstrap required, opened a new log
I20260811 05:03:21.404804 24504 ts_tablet_manager.cc:1397] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260811 05:03:21.405115 24502 tablet_bootstrap.cc:492] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955: No bootstrap required, opened a new log
I20260811 05:03:21.405241 24502 ts_tablet_manager.cc:1397] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:21.405284 24504 raft_consensus.cc:348] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.405427 24504 raft_consensus.cc:374] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:21.405467 24504 raft_consensus.cc:729] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e18da5280db4fc7b68b57f3b6980f55, State: Initialized, Role: FOLLOWER
I20260811 05:03:21.405666 24504 consensus_queue.cc:260] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.405733 24502 raft_consensus.cc:348] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.405885 24502 raft_consensus.cc:374] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:21.405944 24502 raft_consensus.cc:729] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72beb8a856764e32ab84d5cbaf605955, State: Initialized, Role: FOLLOWER
I20260811 05:03:21.406088 24502 consensus_queue.cc:260] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.406260 24503 tablet_bootstrap.cc:492] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c: Bootstrap starting.
I20260811 05:03:21.406419 24502 ts_tablet_manager.cc:1428] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:21.407307 24503 tablet_bootstrap.cc:654] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:21.407893 24527 ts_tablet_manager.cc:1905] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:21.409207 24503 tablet_bootstrap.cc:492] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c: No bootstrap required, opened a new log
I20260811 05:03:21.409309 24503 ts_tablet_manager.cc:1397] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:21.409787 24503 raft_consensus.cc:348] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.409907 24503 raft_consensus.cc:374] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:21.409950 24503 raft_consensus.cc:729] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 900a9d7a920d4b1db1b8667ad0a0840c, State: Initialized, Role: FOLLOWER
I20260811 05:03:21.410089 24503 consensus_queue.cc:260] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.410414 24504 ts_tablet_manager.cc:1428] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260811 05:03:21.411437 24503 ts_tablet_manager.cc:1428] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:03:21.411549 24527 ts_tablet_manager.cc:1918] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:21.411666 24527 log.cc:1196] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/wal/wals/2c5c65217cc74d22b87c653bd2ce5464
I20260811 05:03:21.412061 24527 ts_tablet_manager.cc:1939] T 2c5c65217cc74d22b87c653bd2ce5464 P 72beb8a856764e32ab84d5cbaf605955: Deleting consensus metadata
I20260811 05:03:21.413497 23932 catalog_manager.cc:4841] TS 72beb8a856764e32ab84d5cbaf605955 (127.22.49.193:43769): tablet 2c5c65217cc74d22b87c653bd2ce5464 (table test-table [id=76cd6f50279d4cf4b9c3896300d77a8a]) successfully deleted
I20260811 05:03:21.564250 24509 raft_consensus.cc:482] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:21.564498 24509 raft_consensus.cc:504] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.565672 24509 leader_election.cc:288] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72beb8a856764e32ab84d5cbaf605955 (127.22.49.193:43769), 0e18da5280db4fc7b68b57f3b6980f55 (127.22.49.194:45389)
I20260811 05:03:21.570034 24497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.566064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:49231 (local address 127.22.49.193:43769)
0811 05:03:21.566214 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:21.566218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:21.566334 (+ 116us) server_negotiation.cc:407] Connection header received
0811 05:03:21.566601 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:21.566606 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:21.566665 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:21.566751 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:21.567297 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.567796 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.568956 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.569374 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.569509 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.569563 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:21.569800 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 05:03:21.569888 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 05:03:21.570037 24501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.566473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:35567 (local address 127.22.49.194:45389)
0811 05:03:21.566624 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:21.566628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:21.566656 (+ 28us) server_negotiation.cc:407] Connection header received
0811 05:03:21.566767 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:21.566769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:21.566810 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:21.566865 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:21.567291 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.567795 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.568963 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.569383 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.569521 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.569573 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:21.569803 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 05:03:21.569884 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 05:03:21.570086 24533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.566330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:45389 (local address 127.22.49.195:35567)
0811 05:03:21.566580 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:21.566594 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:21.566675 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:21.566919 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:21.566921 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:21.566936 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:21.567162 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.567169 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.567918 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.567923 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.568823 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.568834 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.569515 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.569519 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.569669 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.569687 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 05:03:21.569787 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 05:03:21.569890 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":34,"thread_start_us":86,"threads_started":1}
I20260811 05:03:21.570123 24532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.565923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:43769 (local address 127.22.49.195:49231)
0811 05:03:21.566191 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:21.566208 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:21.566326 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:21.566955 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:21.566957 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:21.567026 (+ 69us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:21.567174 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.567179 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.567910 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.567915 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.568827 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.568837 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.569499 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.569502 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.569612 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.569676 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 05:03:21.569780 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 05:03:21.569888 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":141,"thread_start_us":99,"threads_started":1}
I20260811 05:03:21.570871 24110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f60d1745686a409cac9f5bdd6355a94f" candidate_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72beb8a856764e32ab84d5cbaf605955" is_pre_election: true
I20260811 05:03:21.570931 24268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f60d1745686a409cac9f5bdd6355a94f" candidate_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e18da5280db4fc7b68b57f3b6980f55" is_pre_election: true
I20260811 05:03:21.571115 24110 raft_consensus.cc:2454] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 900a9d7a920d4b1db1b8667ad0a0840c in term 0.
I20260811 05:03:21.571215 24268 raft_consensus.cc:2454] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 900a9d7a920d4b1db1b8667ad0a0840c in term 0.
I20260811 05:03:21.571600 24352 leader_election.cc:302] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72beb8a856764e32ab84d5cbaf605955, 900a9d7a920d4b1db1b8667ad0a0840c; no voters:
I20260811 05:03:21.571894 24509 raft_consensus.cc:2781] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:21.571957 24509 raft_consensus.cc:482] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:21.571985 24509 raft_consensus.cc:3037] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:21.573087 24509 raft_consensus.cc:504] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.573474 24509 leader_election.cc:288] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [CANDIDATE]: Term 1 election: Requested vote from peers 72beb8a856764e32ab84d5cbaf605955 (127.22.49.193:43769), 0e18da5280db4fc7b68b57f3b6980f55 (127.22.49.194:45389)
I20260811 05:03:21.573906 24110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f60d1745686a409cac9f5bdd6355a94f" candidate_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72beb8a856764e32ab84d5cbaf605955"
I20260811 05:03:21.573972 24268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f60d1745686a409cac9f5bdd6355a94f" candidate_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e18da5280db4fc7b68b57f3b6980f55"
I20260811 05:03:21.574043 24110 raft_consensus.cc:3037] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:21.574131 24268 raft_consensus.cc:3037] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:21.575167 24268 raft_consensus.cc:2454] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 900a9d7a920d4b1db1b8667ad0a0840c in term 1.
I20260811 05:03:21.575174 24110 raft_consensus.cc:2454] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 900a9d7a920d4b1db1b8667ad0a0840c in term 1.
I20260811 05:03:21.575486 24352 leader_election.cc:302] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72beb8a856764e32ab84d5cbaf605955, 900a9d7a920d4b1db1b8667ad0a0840c; no voters:
I20260811 05:03:21.575656 24509 raft_consensus.cc:2781] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:21.575843 24509 raft_consensus.cc:686] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [term 1 LEADER]: Becoming Leader. State: Replica: 900a9d7a920d4b1db1b8667ad0a0840c, State: Running, Role: LEADER
I20260811 05:03:21.576119 24509 consensus_queue.cc:237] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.578595 23946 catalog_manager.cc:5495] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c reported cstate change: term changed from 0 to 1, leader changed from <none> to 900a9d7a920d4b1db1b8667ad0a0840c (127.22.49.195). New cstate: current_term: 1 leader_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } health_report { overall_health: HEALTHY } } }
Aug 11 05:03:21 dist-test-slave-w206 krb5kdc[23898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424600, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:21.638057 24543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.628961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:32993 (local address 127.0.0.1:54652)
0811 05:03:21.629291 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:21.629311 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:21.629411 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:21.629668 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:21.629670 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:21.630081 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:21.630178 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.630185 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.631071 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.631074 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.631643 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.631651 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.632089 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.632092 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.632152 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.632730 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:21.632742 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:21.634317 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:21.636483 (+ 2166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:21.636493 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:21.636499 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:21.636740 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:21.637012 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:21.637014 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:21.637016 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:21.637104 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:21.637554 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:21.637560 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:21.637672 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 05:03:21.637767 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 05:03:21.637903 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":145,"threads_started":1}
I20260811 05:03:21.638105 24544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.629088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54652 (local address 127.22.49.254:32993)
0811 05:03:21.629426 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:21.629434 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:21.629451 (+ 17us) server_negotiation.cc:407] Connection header received
0811 05:03:21.629492 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:21.629494 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:21.629535 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:21.629631 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:21.630323 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.630900 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.631746 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.631984 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.632067 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.634507 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:21.634511 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:21.634514 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:21.634538 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:21.636369 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:21.636828 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:21.636830 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:21.636831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:21.636931 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:21.637182 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:21.637184 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:21.637185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:21.637456 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:21.637538 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:21.637825 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 05:03:21.637984 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":267,"thread_start_us":202,"threads_started":1}
I20260811 05:03:21.642657 23946 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:54652:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 05:03:21.643510 23946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:21.648984 24401 tablet_service.cc:1467] Processing CreateTablet for tablet d9319d3dbb05486a9ca28bc6566a0fe6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0021fe61a29a4d6484a16e64578fd481]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:03:21.648937 24247 tablet_service.cc:1467] Processing CreateTablet for tablet d9319d3dbb05486a9ca28bc6566a0fe6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0021fe61a29a4d6484a16e64578fd481]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:03:21.648954 24095 tablet_service.cc:1467] Processing CreateTablet for tablet d9319d3dbb05486a9ca28bc6566a0fe6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0021fe61a29a4d6484a16e64578fd481]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:03:21.649385 24247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9319d3dbb05486a9ca28bc6566a0fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:21.649385 24401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9319d3dbb05486a9ca28bc6566a0fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:21.649389 24095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9319d3dbb05486a9ca28bc6566a0fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:21.652385 24503 tablet_bootstrap.cc:492] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c: Bootstrap starting.
I20260811 05:03:21.652385 24504 tablet_bootstrap.cc:492] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55: Bootstrap starting.
I20260811 05:03:21.652850 24502 tablet_bootstrap.cc:492] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955: Bootstrap starting.
I20260811 05:03:21.653272 24504 tablet_bootstrap.cc:654] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:21.653467 24503 tablet_bootstrap.cc:654] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:21.653857 24502 tablet_bootstrap.cc:654] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:21.654451 24504 tablet_bootstrap.cc:492] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55: No bootstrap required, opened a new log
I20260811 05:03:21.654587 24504 ts_tablet_manager.cc:1397] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260811 05:03:21.654883 24503 tablet_bootstrap.cc:492] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c: No bootstrap required, opened a new log
I20260811 05:03:21.654999 24503 ts_tablet_manager.cc:1397] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:21.655126 24504 raft_consensus.cc:348] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.655251 24504 raft_consensus.cc:374] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:21.655284 24504 raft_consensus.cc:729] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e18da5280db4fc7b68b57f3b6980f55, State: Initialized, Role: FOLLOWER
I20260811 05:03:21.655289 24502 tablet_bootstrap.cc:492] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955: No bootstrap required, opened a new log
I20260811 05:03:21.655378 24502 ts_tablet_manager.cc:1397] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:21.655421 24504 consensus_queue.cc:260] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.655462 24503 raft_consensus.cc:348] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.655591 24503 raft_consensus.cc:374] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:21.655622 24503 raft_consensus.cc:729] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 900a9d7a920d4b1db1b8667ad0a0840c, State: Initialized, Role: FOLLOWER
I20260811 05:03:21.655778 24503 consensus_queue.cc:260] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.655829 24502 raft_consensus.cc:348] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.655961 24502 raft_consensus.cc:374] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:21.656000 24502 raft_consensus.cc:729] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72beb8a856764e32ab84d5cbaf605955, State: Initialized, Role: FOLLOWER
I20260811 05:03:21.656093 24503 ts_tablet_manager.cc:1428] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:21.656116 24502 consensus_queue.cc:260] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.656136 24509 tablet_replica.cc:439] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } } }
I20260811 05:03:21.656153 24522 tablet_replica.cc:439] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } } }
I20260811 05:03:21.656275 24509 tablet_replica.cc:442] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:21.656287 24522 tablet_replica.cc:442] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:21.656442 24502 ts_tablet_manager.cc:1428] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 05:03:21.656379 24508 tablet_replica.cc:439] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } } }
I20260811 05:03:21.656515 24504 ts_tablet_manager.cc:1428] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 05:03:21.656534 24508 tablet_replica.cc:442] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:21.675155 24509 raft_consensus.cc:482] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:21.675287 24509 raft_consensus.cc:504] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.675711 24509 leader_election.cc:288] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72beb8a856764e32ab84d5cbaf605955 (127.22.49.193:43769), 0e18da5280db4fc7b68b57f3b6980f55 (127.22.49.194:45389)
I20260811 05:03:21.676260 24268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9319d3dbb05486a9ca28bc6566a0fe6" candidate_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e18da5280db4fc7b68b57f3b6980f55" is_pre_election: true
I20260811 05:03:21.676262 24110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9319d3dbb05486a9ca28bc6566a0fe6" candidate_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72beb8a856764e32ab84d5cbaf605955" is_pre_election: true
I20260811 05:03:21.676412 24268 raft_consensus.cc:2454] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 900a9d7a920d4b1db1b8667ad0a0840c in term 0.
I20260811 05:03:21.676529 24110 raft_consensus.cc:2454] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 900a9d7a920d4b1db1b8667ad0a0840c in term 0.
I20260811 05:03:21.676755 24352 leader_election.cc:302] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e18da5280db4fc7b68b57f3b6980f55, 900a9d7a920d4b1db1b8667ad0a0840c; no voters:
I20260811 05:03:21.677007 24509 raft_consensus.cc:2781] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:21.677098 24509 raft_consensus.cc:482] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:21.677155 24509 raft_consensus.cc:3037] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:21.678234 24509 raft_consensus.cc:504] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.678617 24509 leader_election.cc:288] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [CANDIDATE]: Term 1 election: Requested vote from peers 72beb8a856764e32ab84d5cbaf605955 (127.22.49.193:43769), 0e18da5280db4fc7b68b57f3b6980f55 (127.22.49.194:45389)
I20260811 05:03:21.679244 24268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9319d3dbb05486a9ca28bc6566a0fe6" candidate_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e18da5280db4fc7b68b57f3b6980f55"
I20260811 05:03:21.679256 24110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9319d3dbb05486a9ca28bc6566a0fe6" candidate_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72beb8a856764e32ab84d5cbaf605955"
I20260811 05:03:21.679369 24110 raft_consensus.cc:3037] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:21.679399 24268 raft_consensus.cc:3037] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:21.680400 24268 raft_consensus.cc:2454] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 900a9d7a920d4b1db1b8667ad0a0840c in term 1.
I20260811 05:03:21.680485 24110 raft_consensus.cc:2454] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 900a9d7a920d4b1db1b8667ad0a0840c in term 1.
I20260811 05:03:21.680720 24352 leader_election.cc:302] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e18da5280db4fc7b68b57f3b6980f55, 900a9d7a920d4b1db1b8667ad0a0840c; no voters:
I20260811 05:03:21.680981 24509 raft_consensus.cc:2781] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:21.681090 24509 raft_consensus.cc:686] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [term 1 LEADER]: Becoming Leader. State: Replica: 900a9d7a920d4b1db1b8667ad0a0840c, State: Running, Role: LEADER
I20260811 05:03:21.681236 24509 consensus_queue.cc:237] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } }
I20260811 05:03:21.682085 24534 tablet_replica.cc:439] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c: TxnStatusTablet state changed. Reason: New leader 900a9d7a920d4b1db1b8667ad0a0840c. Latest consensus state: current_term: 1 leader_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } } }
I20260811 05:03:21.682191 24534 tablet_replica.cc:442] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:03:21.682755 24550 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 05:03:21.683104 24550 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 05:03:21.683358 23946 catalog_manager.cc:5495] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c reported cstate change: term changed from 0 to 1, leader changed from <none> to 900a9d7a920d4b1db1b8667ad0a0840c (127.22.49.195). New cstate: current_term: 1 leader_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } health_report { overall_health: HEALTHY } } }
I20260811 05:03:21.700974 24543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.696951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:42607 (local address 127.0.0.1:45290)
0811 05:03:21.697202 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:21.697219 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:21.697346 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:21.697682 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:21.697685 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:21.697694 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:03:21.697813 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.697818 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.698534 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.698538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.699227 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.699236 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.699686 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.699690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.699791 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.699839 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:03:21.700630 (+ 791us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:03:21.700649 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 05:03:21.700727 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 05:03:21.700826 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130}
I20260811 05:03:21.700974 24499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.697085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45290 (local address 127.22.49.195:42607)
0811 05:03:21.697244 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:21.697251 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:21.697268 (+ 17us) server_negotiation.cc:407] Connection header received
0811 05:03:21.697499 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:21.697502 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:21.697558 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:21.697656 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:21.697921 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.698420 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.699348 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.699568 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.699675 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.700020 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:21.700479 (+ 459us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:21.700657 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:21.700756 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 05:03:21.700813 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 05:03:21.704572 24268 raft_consensus.cc:1261] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55 [term 1 FOLLOWER]: Refusing update from remote peer 900a9d7a920d4b1db1b8667ad0a0840c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:21.705122 24110 raft_consensus.cc:1261] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955 [term 1 FOLLOWER]: Refusing update from remote peer 900a9d7a920d4b1db1b8667ad0a0840c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:21.705281 24534 consensus_queue.cc:1035] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:21.705503 24509 consensus_queue.cc:1035] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:21.706899 24508 tablet_replica.cc:439] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955: TxnStatusTablet state changed. Reason: New leader 900a9d7a920d4b1db1b8667ad0a0840c. Latest consensus state: current_term: 1 leader_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } } }
I20260811 05:03:21.707053 24508 tablet_replica.cc:442] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:21.708434 24522 tablet_replica.cc:439] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55: TxnStatusTablet state changed. Reason: New leader 900a9d7a920d4b1db1b8667ad0a0840c. Latest consensus state: current_term: 1 leader_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } } }
I20260811 05:03:21.708572 24522 tablet_replica.cc:442] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:21.710770 24509 tablet_replica.cc:439] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } } }
I20260811 05:03:21.710928 24509 tablet_replica.cc:442] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:03:21.711092 24509 tablet_replica.cc:439] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } } }
I20260811 05:03:21.711182 24509 tablet_replica.cc:442] T d9319d3dbb05486a9ca28bc6566a0fe6 P 900a9d7a920d4b1db1b8667ad0a0840c: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:03:21.712497 24508 tablet_replica.cc:439] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } } }
I20260811 05:03:21.712631 24508 tablet_replica.cc:442] T d9319d3dbb05486a9ca28bc6566a0fe6 P 72beb8a856764e32ab84d5cbaf605955: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:21.713792 24522 tablet_replica.cc:439] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 } } peers { permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 } } peers { permanent_uuid: "900a9d7a920d4b1db1b8667ad0a0840c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 42607 } } }
I20260811 05:03:21.713934 24522 tablet_replica.cc:442] T d9319d3dbb05486a9ca28bc6566a0fe6 P 0e18da5280db4fc7b68b57f3b6980f55: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:21.713948 24516 mvcc.cc:205] Tried to move back new op lower bound from 7317195168575873024 to 7317195168488087552. Current Snapshot: MvccSnapshot[applied={T|T < 7317195168575873024 or (T in {7317195168575873024})}]
I20260811 05:03:21.721810 24499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.718549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45296 (local address 127.22.49.195:42607)
0811 05:03:21.718661 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:21.718665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:21.718677 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:03:21.718721 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:21.718724 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:21.718772 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:21.718846 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:21.719170 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.719679 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.720680 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.720917 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.721054 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.721303 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:21.721414 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:21.721504 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:21.721600 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 05:03:21.721668 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 05:03:21.736016 24499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.732041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:39367 (local address 127.22.49.195:42607)
0811 05:03:21.732188 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:21.732192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:21.732507 (+ 315us) server_negotiation.cc:407] Connection header received
0811 05:03:21.732668 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:21.732673 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:21.732721 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:21.732799 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:21.733117 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.733610 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.734621 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.734962 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.735103 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.735482 (+ 379us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:21.735568 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:21.735612 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:21.735793 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 05:03:21.735864 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":54}
I20260811 05:03:21.736063 24558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.731994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:42607 (local address 127.22.49.195:39367)
0811 05:03:21.732420 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:21.732432 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:21.732561 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:21.732816 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:21.732819 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:21.732826 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:03:21.733007 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.733014 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.733715 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.733722 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.734496 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:21.734514 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.735112 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.735115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:21.735226 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.735269 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:03:21.735651 (+ 382us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:03:21.735653 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 05:03:21.735782 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 05:03:21.735930 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":8,"thread_start_us":150,"threads_started":1}
I20260811 05:03:21.744504 24268 raft_consensus.cc:1261] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55 [term 1 FOLLOWER]: Refusing update from remote peer 900a9d7a920d4b1db1b8667ad0a0840c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:21.744627 24110 raft_consensus.cc:1261] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955 [term 1 FOLLOWER]: Refusing update from remote peer 900a9d7a920d4b1db1b8667ad0a0840c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:21.745030 24555 consensus_queue.cc:1035] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e18da5280db4fc7b68b57f3b6980f55" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 45389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:21.745226 24509 consensus_queue.cc:1035] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72beb8a856764e32ab84d5cbaf605955" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:21.793462 23945 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:21.793619 23945 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:21.795878 23945 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a785cb8c45594c2a9df4cf1cc93ee970: Sending DeleteTablet for 3 replicas of tablet f60d1745686a409cac9f5bdd6355a94f
I20260811 05:03:21.796466 24095 tablet_service.cc:1514] Processing DeleteTablet for tablet f60d1745686a409cac9f5bdd6355a94f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:21 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:55498
I20260811 05:03:21.796563 24247 tablet_service.cc:1514] Processing DeleteTablet for tablet f60d1745686a409cac9f5bdd6355a94f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:21 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:60584
I20260811 05:03:21.796656 24527 tablet_replica.cc:330] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955: stopping tablet replica
I20260811 05:03:21.796764 24527 raft_consensus.cc:2229] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:21.796873 24527 raft_consensus.cc:2258] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:21.796969 24400 tablet_service.cc:1514] Processing DeleteTablet for tablet f60d1745686a409cac9f5bdd6355a94f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:21 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:45276
I20260811 05:03:21.797035 24528 tablet_replica.cc:330] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55: stopping tablet replica
I20260811 05:03:21.797147 24528 raft_consensus.cc:2229] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:21.797252 24528 raft_consensus.cc:2258] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:21.797362 24526 tablet_replica.cc:330] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c: stopping tablet replica
I20260811 05:03:21.797493 24526 raft_consensus.cc:2229] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:03:21.797864 24526 raft_consensus.cc:2258] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:21.798008 24528 ts_tablet_manager.cc:1905] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:21.799162 24527 ts_tablet_manager.cc:1905] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:21.799338 24526 ts_tablet_manager.cc:1905] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:21.801141 24528 ts_tablet_manager.cc:1918] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:03:21.801210 24528 log.cc:1196] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/f60d1745686a409cac9f5bdd6355a94f
I20260811 05:03:21.801471 24528 ts_tablet_manager.cc:1939] T f60d1745686a409cac9f5bdd6355a94f P 0e18da5280db4fc7b68b57f3b6980f55: Deleting consensus metadata
I20260811 05:03:21.801939 24526 ts_tablet_manager.cc:1918] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:03:21.801924 24527 ts_tablet_manager.cc:1918] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:03:21.802001 24526 log.cc:1196] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/f60d1745686a409cac9f5bdd6355a94f
I20260811 05:03:21.802273 24526 ts_tablet_manager.cc:1939] T f60d1745686a409cac9f5bdd6355a94f P 900a9d7a920d4b1db1b8667ad0a0840c: Deleting consensus metadata
I20260811 05:03:21.802256 23932 catalog_manager.cc:4841] TS 0e18da5280db4fc7b68b57f3b6980f55 (127.22.49.194:45389): tablet f60d1745686a409cac9f5bdd6355a94f (table test-table [id=0f9077ea61b2485ba1b7f9c257dedea3]) successfully deleted
I20260811 05:03:21.802002 24527 log.cc:1196] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786424592714304-22727-0/minicluster-data/ts-0/wal/wals/f60d1745686a409cac9f5bdd6355a94f
I20260811 05:03:21.802707 24527 ts_tablet_manager.cc:1939] T f60d1745686a409cac9f5bdd6355a94f P 72beb8a856764e32ab84d5cbaf605955: Deleting consensus metadata
I20260811 05:03:21.803282 23930 catalog_manager.cc:4841] TS 900a9d7a920d4b1db1b8667ad0a0840c (127.22.49.195:42607): tablet f60d1745686a409cac9f5bdd6355a94f (table test-table [id=0f9077ea61b2485ba1b7f9c257dedea3]) successfully deleted
I20260811 05:03:21.803426 23932 catalog_manager.cc:4841] TS 72beb8a856764e32ab84d5cbaf605955 (127.22.49.193:43769): tablet f60d1745686a409cac9f5bdd6355a94f (table test-table [id=0f9077ea61b2485ba1b7f9c257dedea3]) successfully deleted
Aug 11 05:03:21 dist-test-slave-w206 krb5kdc[23898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424601, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.49.193@KRBTEST.COM
I20260811 05:03:21.814692 24497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.798270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55514 (local address 127.22.49.193:43769)
0811 05:03:21.798395 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:21.798402 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:21.803568 (+ 5166us) server_negotiation.cc:407] Connection header received
0811 05:03:21.803783 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:21.803786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:21.803841 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:21.803929 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:21.804779 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.805516 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.806362 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.806678 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.806789 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.810528 (+ 3739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:21.810543 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:21.810558 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:21.810588 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:21.812778 (+ 2190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:21.813327 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:21.813334 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:21.813336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:21.813444 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:21.813711 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:21.813714 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:21.813716 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:21.814025 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:21.814224 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:21.814360 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 05:03:21.814502 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 05:03:21.815428 24155 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55514
I20260811 05:03:21.826221 24544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:21.817407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54654 (local address 127.22.49.254:32993)
0811 05:03:21.817561 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:21.817564 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:21.817578 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:03:21.817622 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:21.817624 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:21.817664 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:21.817730 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:21.818562 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.819174 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.820336 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:21.820645 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:21.820730 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:21.822326 (+ 1596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:21.822331 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:21.822334 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:21.822369 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:21.824220 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:21.824754 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:21.824757 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:21.824759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:21.824871 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:21.825203 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:21.825208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:21.825211 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:21.825475 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:21.825619 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:21.825896 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 05:03:21.826046 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 05:03:21.826793 23945 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54654
I20260811 05:03:21.828423 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 24027
I20260811 05:03:21.841463 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 24179
I20260811 05:03:21.852380 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 24332
I20260811 05:03:21.862051 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 23912
2026-08-11T05:03:21Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3352 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:03:21 dist-test-slave-w206 krb5kdc[24570](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:03:21 dist-test-slave-w206 krb5kdc[24570](info): set up 2 sockets
Aug 11 05:03:21 dist-test-slave-w206 krb5kdc[24570](info): commencing operation
krb5kdc: starting...
W20260811 05:03:22.985949 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:03:23 dist-test-slave-w206 krb5kdc[24570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:03:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:03:23.148603 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:42089
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:35795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:42089
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:23.284904 24583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:23.285295 24583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:23.285387 24583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:23.290365 24583 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:23.290529 24583 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 05:03:23.290570 24583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:23.290621 24583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:23.290692 24583 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:23.290737 24583 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:03:23.297991 24583 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:35795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:42089
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:42089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:23.299427 24583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:23.300613 24583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:23.310504 24591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:23.310494 24589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:23.310581 24583 server_base.cc:1034] running on GCE node
W20260811 05:03:23.310592 24588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:23.311623 24583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:23.313036 24583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:23.314245 24583 hybrid_clock.cc:648] HybridClock initialized: now 1786424603314231 us; error 42 us; skew 500 ppm
Aug 11 05:03:23 dist-test-slave-w206 krb5kdc[24570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424603, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:23.322455 24583 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:03:23.323773 24583 webserver.cc:460] Webserver started at http://127.22.49.254:42493/ using document root <none> and password file <none>
I20260811 05:03:23.324533 24583 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:23.324658 24583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:23.324945 24583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:23.327517 24583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "fde78eab36334127b240cc6bf90c4394"
format_stamp: "Formatted at 2026-08-11 05:03:23 on dist-test-slave-w206"
server_key: "8a532acd33025ddd90bded2c2a093af4"
server_key_iv: "81d3a4e3aed0fa545bc3598db0485064"
server_key_version: "encryptionkey@0"
I20260811 05:03:23.328284 24583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "fde78eab36334127b240cc6bf90c4394"
format_stamp: "Formatted at 2026-08-11 05:03:23 on dist-test-slave-w206"
server_key: "8a532acd33025ddd90bded2c2a093af4"
server_key_iv: "81d3a4e3aed0fa545bc3598db0485064"
server_key_version: "encryptionkey@0"
I20260811 05:03:23.333279 24583 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 05:03:23.336884 24599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:23.338765 24583 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:23.339113 24583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "fde78eab36334127b240cc6bf90c4394"
format_stamp: "Formatted at 2026-08-11 05:03:23 on dist-test-slave-w206"
server_key: "8a532acd33025ddd90bded2c2a093af4"
server_key_iv: "81d3a4e3aed0fa545bc3598db0485064"
server_key_version: "encryptionkey@0"
I20260811 05:03:23.339308 24583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:23.363209 24583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:23.367961 24583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:23.368253 24583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:23.378607 24583 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:42089
I20260811 05:03:23.378676 24668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:42089 every 8 connection(s)
I20260811 05:03:23.379949 24583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:23.383745 24669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:23.390064 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 24583
I20260811 05:03:23.390230 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:23.390959 22727 external_mini_cluster.cc:1428] Setting key a07900e7192877f7ba97c706002310de
I20260811 05:03:23.392577 24669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394: Bootstrap starting.
I20260811 05:03:23.396478 24669 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:23.397722 24669 log.cc:824] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:23.400919 24669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394: No bootstrap required, opened a new log
Aug 11 05:03:23 dist-test-slave-w206 krb5kdc[24570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:23.406096 24669 raft_consensus.cc:348] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde78eab36334127b240cc6bf90c4394" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42089 } }
I20260811 05:03:23.406450 24669 raft_consensus.cc:374] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:23.406565 24669 raft_consensus.cc:729] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fde78eab36334127b240cc6bf90c4394, State: Initialized, Role: FOLLOWER
I20260811 05:03:23.407291 24669 consensus_queue.cc:260] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde78eab36334127b240cc6bf90c4394" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42089 } }
I20260811 05:03:23.407588 24669 raft_consensus.cc:388] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:23.407697 24669 raft_consensus.cc:482] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:23.407825 24669 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:23.409688 24669 raft_consensus.cc:504] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde78eab36334127b240cc6bf90c4394" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42089 } }
I20260811 05:03:23.410617 24669 leader_election.cc:302] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fde78eab36334127b240cc6bf90c4394; no voters:
I20260811 05:03:23.411242 24669 leader_election.cc:288] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:23.411388 24676 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:23.411906 24676 raft_consensus.cc:686] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [term 1 LEADER]: Becoming Leader. State: Replica: fde78eab36334127b240cc6bf90c4394, State: Running, Role: LEADER
I20260811 05:03:23.412319 24676 consensus_queue.cc:237] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde78eab36334127b240cc6bf90c4394" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42089 } }
I20260811 05:03:23.413193 24669 sys_catalog.cc:564] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:23.413228 24672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:23.393540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49086 (local address 127.22.49.254:42089)
0811 05:03:23.394227 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:23.394250 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:23.394338 (+ 88us) server_negotiation.cc:407] Connection header received
0811 05:03:23.395387 (+ 1049us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:23.395414 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:23.395892 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:23.396284 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:23.397542 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:23.398918 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:23.400537 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:23.401586 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:23.401766 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:23.405506 (+ 3740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:23.405514 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:23.405535 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:23.405581 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:23.408131 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:23.408769 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:23.408790 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:23.408797 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:23.408958 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:23.409686 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:23.409698 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:23.409700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:23.410702 (+ 1002us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:23.411037 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:23.411515 (+ 478us) server_negotiation.cc:299] Negotiation successful
0811 05:03:23.412284 (+ 769us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":239,"threads_started":1}
I20260811 05:03:23.413815 24676 sys_catalog.cc:455] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fde78eab36334127b240cc6bf90c4394. Latest consensus state: current_term: 1 leader_uuid: "fde78eab36334127b240cc6bf90c4394" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde78eab36334127b240cc6bf90c4394" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42089 } } }
I20260811 05:03:23.413856 24677 sys_catalog.cc:455] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fde78eab36334127b240cc6bf90c4394" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde78eab36334127b240cc6bf90c4394" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42089 } } }
I20260811 05:03:23.413978 24677 sys_catalog.cc:458] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:23.413980 24676 sys_catalog.cc:458] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:23.414564 24681 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:23.418671 24681 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:23.428431 24681 catalog_manager.cc:1347] Generated new cluster ID: 67234b39b21645a38b408c19a02f5659
I20260811 05:03:23.428551 24681 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:23.445497 24681 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:23.446635 24681 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:23.454586 24681 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394: Generated new TSK 0
I20260811 05:03:23.455688 24681 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:03:23.504980 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:42089
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:35795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:23.653923 24700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:23.654327 24700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:23.654420 24700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:23.659410 24700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:23.659571 24700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:23.659655 24700 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 05:03:23.659688 24700 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:03:23.659759 24700 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:03:23.666276 24700 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:35795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.49.254:42089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:23.667929 24700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:23.669258 24700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:23.681617 24706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:23.681675 24705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:23.681674 24708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:23.681982 24700 server_base.cc:1034] running on GCE node
I20260811 05:03:23.682498 24700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:23.683359 24700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:23.684561 24700 hybrid_clock.cc:648] HybridClock initialized: now 1786424603684517 us; error 55 us; skew 500 ppm
Aug 11 05:03:23 dist-test-slave-w206 krb5kdc[24570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424603, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:23.687920 24700 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:03:23.689149 24700 webserver.cc:460] Webserver started at http://127.22.49.193:42399/ using document root <none> and password file <none>
I20260811 05:03:23.689810 24700 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:23.689916 24700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:23.690183 24700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:23.692636 24700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "1c2ac2a0e9fb4eec98b1410f576345ca"
format_stamp: "Formatted at 2026-08-11 05:03:23 on dist-test-slave-w206"
server_key: "8c764c4b8c7a68d9d33bc9147e15c888"
server_key_iv: "c88324ab8eb88e267d1c49421ea7c682"
server_key_version: "encryptionkey@0"
I20260811 05:03:23.693368 24700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "1c2ac2a0e9fb4eec98b1410f576345ca"
format_stamp: "Formatted at 2026-08-11 05:03:23 on dist-test-slave-w206"
server_key: "8c764c4b8c7a68d9d33bc9147e15c888"
server_key_iv: "c88324ab8eb88e267d1c49421ea7c682"
server_key_version: "encryptionkey@0"
I20260811 05:03:23.698128 24700 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 05:03:23.701534 24715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:23.703145 24700 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 05:03:23.703382 24700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "1c2ac2a0e9fb4eec98b1410f576345ca"
format_stamp: "Formatted at 2026-08-11 05:03:23 on dist-test-slave-w206"
server_key: "8c764c4b8c7a68d9d33bc9147e15c888"
server_key_iv: "c88324ab8eb88e267d1c49421ea7c682"
server_key_version: "encryptionkey@0"
I20260811 05:03:23.703553 24700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:23.736104 24700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:23.741353 24700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:23.741647 24700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:23.743453 24700 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:23.743541 24700 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:23.743614 24700 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:23.743659 24700 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:23.756089 24700 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:39553
I20260811 05:03:23.756110 24844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:39553 every 8 connection(s)
Aug 11 05:03:23 dist-test-slave-w206 krb5kdc[24570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424603, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:23.757423 24700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:03:23.762372 24672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:23.744575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:54509 (local address 127.22.49.254:42089)
0811 05:03:23.744781 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:23.744797 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:23.746165 (+ 1368us) server_negotiation.cc:407] Connection header received
0811 05:03:23.748044 (+ 1879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:23.748050 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:23.748164 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:23.748294 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:23.750235 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:23.751030 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:23.753265 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:23.753575 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:23.753718 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:23.757622 (+ 3904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:23.757627 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:23.757630 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:23.757665 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:23.759619 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:23.760461 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:23.760465 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:23.760466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:23.760566 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:23.761049 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:23.761053 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:23.761054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:23.761284 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:23.761431 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:23.762077 (+ 646us) server_negotiation.cc:299] Negotiation successful
0811 05:03:23.762229 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 05:03:23.763608 24727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:23.745293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:42089 (local address 127.22.49.193:54509)
0811 05:03:23.745839 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:23.745898 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:23.747496 (+ 1598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:23.748613 (+ 1117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:23.748630 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:23.749232 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:23.749997 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:23.750026 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:23.751507 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:23.751514 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:23.753003 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:23.753052 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:23.753802 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:23.753808 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:23.754069 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:23.754948 (+ 879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:23.754969 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:23.757275 (+ 2306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:23.759844 (+ 2569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:23.759851 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:23.759868 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:23.760259 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:23.760718 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:23.760722 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:23.760724 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:23.760926 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:23.761430 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:23.761439 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:23.761764 (+ 325us) client_negotiation.cc:769] Sending connection context
0811 05:03:23.761988 (+ 224us) client_negotiation.cc:240] Negotiation successful
0811 05:03:23.762331 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":147,"threads_started":1}
I20260811 05:03:23.765362 24846 heartbeater.cc:347] Connected to a master server at 127.22.49.254:42089
I20260811 05:03:23.765604 24846 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:23.766281 24846 heartbeater.cc:511] Master 127.22.49.254:42089 requested a full tablet report, sending...
I20260811 05:03:23.766607 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 24700
I20260811 05:03:23.766753 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:03:23.767196 22727 external_mini_cluster.cc:1428] Setting key a65c6661a65042f3f911e33e543fe2a2
I20260811 05:03:23.768704 24618 ts_manager.cc:194] Registered new tserver with Master: 1c2ac2a0e9fb4eec98b1410f576345ca (127.22.49.193:39553)
I20260811 05:03:23.770552 24618 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:54509
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:03:23.780519 24672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:23.769168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:49195 (local address 127.22.49.254:42089)
0811 05:03:23.769310 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:23.769316 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:23.769897 (+ 581us) server_negotiation.cc:407] Connection header received
0811 05:03:23.770081 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:23.770085 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:23.770148 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:23.770253 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:23.770823 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:23.771606 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:23.773289 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:23.773831 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:23.773995 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:23.775942 (+ 1947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:23.775946 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:23.775948 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:23.775989 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:23.777875 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:23.778681 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:23.778685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:23.778686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:23.778795 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:23.779241 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:23.779244 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:23.779245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:23.779530 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:23.779626 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:23.780086 (+ 460us) server_negotiation.cc:299] Negotiation successful
0811 05:03:23.780225 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 05:03:23.780524 24852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:23.769288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:42089 (local address 127.22.49.193:49195)
0811 05:03:23.769779 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:23.769804 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:23.769952 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:23.770280 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:23.770283 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:23.770549 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:23.770676 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:23.770684 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:23.771787 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:23.771794 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:23.772919 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:23.772937 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:23.774043 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:23.774051 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:23.774215 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:23.774924 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:23.774962 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:23.775668 (+ 706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:23.778063 (+ 2395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:23.778070 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:23.778074 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:23.778507 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:23.778933 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:23.778937 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:23.778939 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:23.779110 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:23.779665 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:23.779673 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:23.779818 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 05:03:23.779983 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 05:03:23.780183 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":274,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:03:23.808099 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:42089
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:35795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:23.937700 24855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:23.938046 24855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:23.938100 24855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:23.942728 24855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:23.942838 24855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:23.942885 24855 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 05:03:23.942901 24855 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:03:23.942939 24855 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:03:23.949357 24855 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:35795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.49.254:42089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:23.950630 24855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:23.951783 24855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:23.964298 24860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:23.964533 24861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:23.964628 24863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:23.964850 24855 server_base.cc:1034] running on GCE node
I20260811 05:03:23.965462 24855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:23.966284 24855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:23.967496 24855 hybrid_clock.cc:648] HybridClock initialized: now 1786424603967447 us; error 90 us; skew 500 ppm
Aug 11 05:03:23 dist-test-slave-w206 krb5kdc[24570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424603, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:23.971027 24855 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:03:23.972290 24855 webserver.cc:460] Webserver started at http://127.22.49.194:41963/ using document root <none> and password file <none>
I20260811 05:03:23.972958 24855 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:23.973035 24855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:23.973241 24855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:23.975926 24855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "1fad92cafead4c48ac222b29a79a266e"
format_stamp: "Formatted at 2026-08-11 05:03:23 on dist-test-slave-w206"
server_key: "60c13abda0335b3104d7e4e403d8ca39"
server_key_iv: "7aa34fb94bb3acd36328f2437bfbdeb7"
server_key_version: "encryptionkey@0"
I20260811 05:03:23.976605 24855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "1fad92cafead4c48ac222b29a79a266e"
format_stamp: "Formatted at 2026-08-11 05:03:23 on dist-test-slave-w206"
server_key: "60c13abda0335b3104d7e4e403d8ca39"
server_key_iv: "7aa34fb94bb3acd36328f2437bfbdeb7"
server_key_version: "encryptionkey@0"
I20260811 05:03:23.981925 24855 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 05:03:23.985687 24870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:23.988013 24855 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 05:03:23.988503 24855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "1fad92cafead4c48ac222b29a79a266e"
format_stamp: "Formatted at 2026-08-11 05:03:23 on dist-test-slave-w206"
server_key: "60c13abda0335b3104d7e4e403d8ca39"
server_key_iv: "7aa34fb94bb3acd36328f2437bfbdeb7"
server_key_version: "encryptionkey@0"
I20260811 05:03:23.988683 24855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:24.008235 24855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:24.012660 24855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:24.012897 24855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:24.015184 24855 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:24.015283 24855 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:24.015355 24855 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:24.015393 24855 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 05:03:24 dist-test-slave-w206 krb5kdc[24570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424603, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:24.029428 24855 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:38129
I20260811 05:03:24.029556 25001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:38129 every 8 connection(s)
I20260811 05:03:24.030836 24855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:03:24.033074 24672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.016377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:53723 (local address 127.22.49.254:42089)
0811 05:03:24.016537 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:24.016541 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:24.017978 (+ 1437us) server_negotiation.cc:407] Connection header received
0811 05:03:24.019359 (+ 1381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:24.019362 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:24.019457 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:24.019572 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:24.021195 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.021771 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.023615 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.023868 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.024002 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.028381 (+ 4379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:24.028386 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:24.028388 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:24.028434 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:24.030337 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:24.031208 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:24.031212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:24.031214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:24.031327 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:24.031830 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:24.031835 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:24.031840 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:24.032107 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:24.032212 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:24.032804 (+ 592us) server_negotiation.cc:299] Negotiation successful
0811 05:03:24.032943 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 05:03:24.034083 24881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.017053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:42089 (local address 127.22.49.194:53723)
0811 05:03:24.017737 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:24.017821 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:24.019046 (+ 1225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:24.019816 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:24.019824 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:24.020266 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:24.020998 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.021019 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.021944 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.021948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.023439 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.023453 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.024085 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.024090 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.024303 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.025147 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:24.025169 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:24.028053 (+ 2884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:24.030514 (+ 2461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:24.030521 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:24.030539 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:24.031052 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:24.031500 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:24.031504 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:24.031506 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:24.031700 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:24.032235 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:24.032242 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:24.032519 (+ 277us) client_negotiation.cc:769] Sending connection context
0811 05:03:24.032716 (+ 197us) client_negotiation.cc:240] Negotiation successful
0811 05:03:24.033077 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":205,"threads_started":1}
I20260811 05:03:24.035609 25002 heartbeater.cc:347] Connected to a master server at 127.22.49.254:42089
I20260811 05:03:24.035832 25002 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:24.036444 25002 heartbeater.cc:511] Master 127.22.49.254:42089 requested a full tablet report, sending...
I20260811 05:03:24.037739 24619 ts_manager.cc:194] Registered new tserver with Master: 1fad92cafead4c48ac222b29a79a266e (127.22.49.194:38129)
I20260811 05:03:24.038539 24619 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:53723
I20260811 05:03:24.038919 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 24855
I20260811 05:03:24.039070 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:03:24.039426 22727 external_mini_cluster.cc:1428] Setting key 4aeb10978a19711b2efdcece29f2e013
I20260811 05:03:24.047163 24672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.038245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:38569 (local address 127.22.49.254:42089)
0811 05:03:24.038402 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:24.038407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:24.039024 (+ 617us) server_negotiation.cc:407] Connection header received
0811 05:03:24.039068 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:24.039071 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:24.039123 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:24.039200 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:24.039888 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.040513 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.041658 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.041894 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.041991 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.043492 (+ 1501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:24.043498 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:24.043505 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:24.043531 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:24.045314 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:24.045785 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:24.045792 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:24.045793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:24.045884 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:24.046178 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:24.046183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:24.046185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:24.046440 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:24.046557 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:24.046839 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 05:03:24.046956 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 05:03:24.047178 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.038174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:42089 (local address 127.22.49.194:38569)
0811 05:03:24.038555 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:24.038569 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:24.038701 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:24.039325 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:24.039327 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:24.039592 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:24.039737 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.039744 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.040653 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.040658 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.041501 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.041517 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.042029 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.042035 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.042173 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.042754 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:24.042775 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:24.043339 (+ 564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:24.045449 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:24.045454 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:24.045456 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:24.045674 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:24.045982 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:24.045987 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:24.045989 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:24.046080 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:24.046546 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:24.046549 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:24.046657 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 05:03:24.046770 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 05:03:24.046957 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":3,"thread_start_us":193,"threads_started":1}
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:03:24.075687 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:42089
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:35795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:24.214519 25011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:24.214847 25011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:24.214939 25011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:24.219781 25011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:24.219870 25011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:24.219918 25011 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 05:03:24.219938 25011 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:03:24.219995 25011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:03:24.226042 25011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:35795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.49.254:42089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:24.227274 25011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:24.228343 25011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:24.240381 25016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:24.240386 25017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:24.240813 25011 server_base.cc:1034] running on GCE node
W20260811 05:03:24.240386 25019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:24.241492 25011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:24.242344 25011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:24.243544 25011 hybrid_clock.cc:648] HybridClock initialized: now 1786424604243536 us; error 31 us; skew 500 ppm
Aug 11 05:03:24 dist-test-slave-w206 krb5kdc[24570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424604, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:24.246740 25011 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:03:24.247839 25011 webserver.cc:460] Webserver started at http://127.22.49.195:36095/ using document root <none> and password file <none>
I20260811 05:03:24.248458 25011 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:24.248555 25011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:24.248795 25011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:24.251151 25011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "eb7f38305e0a4f799bc4512ec4d83ea6"
format_stamp: "Formatted at 2026-08-11 05:03:24 on dist-test-slave-w206"
server_key: "f79795257f4b4f6fd8a7cc395e7d9921"
server_key_iv: "b64ea35866114c6cc5ec82ddb48b9d6b"
server_key_version: "encryptionkey@0"
I20260811 05:03:24.251794 25011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "eb7f38305e0a4f799bc4512ec4d83ea6"
format_stamp: "Formatted at 2026-08-11 05:03:24 on dist-test-slave-w206"
server_key: "f79795257f4b4f6fd8a7cc395e7d9921"
server_key_iv: "b64ea35866114c6cc5ec82ddb48b9d6b"
server_key_version: "encryptionkey@0"
I20260811 05:03:24.256114 25011 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:03:24.259056 25026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:24.260464 25011 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 05:03:24.260620 25011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "eb7f38305e0a4f799bc4512ec4d83ea6"
format_stamp: "Formatted at 2026-08-11 05:03:24 on dist-test-slave-w206"
server_key: "f79795257f4b4f6fd8a7cc395e7d9921"
server_key_iv: "b64ea35866114c6cc5ec82ddb48b9d6b"
server_key_version: "encryptionkey@0"
I20260811 05:03:24.260756 25011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:24.282459 25011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:24.286300 25011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:24.286549 25011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:24.288216 25011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:24.288295 25011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:24.288396 25011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:24.288435 25011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 05:03:24 dist-test-slave-w206 krb5kdc[24570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424604, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:24.300143 25011 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:35751
I20260811 05:03:24.300313 25153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:35751 every 8 connection(s)
I20260811 05:03:24.301211 25011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:03:24.303490 24672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.289288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:47577 (local address 127.22.49.254:42089)
0811 05:03:24.289463 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:24.289467 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:24.290545 (+ 1078us) server_negotiation.cc:407] Connection header received
0811 05:03:24.291701 (+ 1156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:24.291707 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:24.291776 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:24.291895 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:24.293550 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.294246 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.295768 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.296218 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.296365 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.299506 (+ 3141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:24.299511 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:24.299515 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:24.299558 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:24.301239 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:24.301861 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:24.301865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:24.301867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:24.301965 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:24.302347 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:24.302350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:24.302351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:24.302548 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:24.302625 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:24.303164 (+ 539us) server_negotiation.cc:299] Negotiation successful
0811 05:03:24.303272 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 05:03:24.304293 25036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.289850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:42089 (local address 127.22.49.195:47577)
0811 05:03:24.290386 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:24.290432 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:24.291463 (+ 1031us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:24.292135 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:24.292146 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:24.292656 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:24.293394 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.293417 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.294389 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.294392 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.295606 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.295617 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.296429 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.296433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.296771 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.297526 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:24.297543 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:24.299291 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:24.301411 (+ 2120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:24.301416 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:24.301428 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:24.301729 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:24.302055 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:24.302058 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:24.302060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:24.302224 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:24.302648 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:24.302653 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:24.302895 (+ 242us) client_negotiation.cc:769] Sending connection context
0811 05:03:24.303111 (+ 216us) client_negotiation.cc:240] Negotiation successful
0811 05:03:24.303433 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":141,"threads_started":1}
I20260811 05:03:24.305269 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 25011
I20260811 05:03:24.305397 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:03:24.305708 22727 external_mini_cluster.cc:1428] Setting key ddbdbf0f55616545f28de6137457b30b
I20260811 05:03:24.306053 25154 heartbeater.cc:347] Connected to a master server at 127.22.49.254:42089
I20260811 05:03:24.306241 25154 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:24.306761 25154 heartbeater.cc:511] Master 127.22.49.254:42089 requested a full tablet report, sending...
I20260811 05:03:24.307891 24619 ts_manager.cc:194] Registered new tserver with Master: eb7f38305e0a4f799bc4512ec4d83ea6 (127.22.49.195:35751)
I20260811 05:03:24.308653 24619 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:47577
I20260811 05:03:24.309508 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:03:24.316732 24672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.308158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:45755 (local address 127.22.49.254:42089)
0811 05:03:24.308263 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:24.308267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:24.308656 (+ 389us) server_negotiation.cc:407] Connection header received
0811 05:03:24.308824 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:24.308856 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:24.308913 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:24.308985 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:24.309665 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.310166 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.311419 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.311626 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.311709 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.313220 (+ 1511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:24.313223 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:24.313226 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:24.313251 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:24.314896 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:24.315442 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:24.315446 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:24.315448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:24.315534 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:24.315842 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:24.315845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:24.315847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:24.316042 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:24.316149 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:24.316432 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 05:03:24.316552 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 05:03:24.316744 25160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.308101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:42089 (local address 127.22.49.195:45755)
0811 05:03:24.308566 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:24.308580 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:24.308698 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:24.309100 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:24.309103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:24.309378 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:24.309492 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.309500 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.310320 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.310326 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.311294 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.311310 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.311740 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.311756 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.311887 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.312606 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:24.312621 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:24.313056 (+ 435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:24.315052 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:24.315056 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:24.315058 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:24.315336 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:24.315638 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:24.315642 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:24.315644 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:24.315735 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:24.316152 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:24.316156 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:24.316252 (+ 96us) client_negotiation.cc:769] Sending connection context
0811 05:03:24.316373 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 05:03:24.316546 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":115,"threads_started":1}
Aug 11 05:03:24 dist-test-slave-w206 krb5kdc[24570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 05:03:24 dist-test-slave-w206 krb5kdc[24570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:24.340773 24672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.331388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49100 (local address 127.22.49.254:42089)
0811 05:03:24.331528 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:24.331531 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:24.331543 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:03:24.331584 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:24.331586 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:24.331624 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:24.331718 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:24.332458 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.332991 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.333880 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.334101 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.334210 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.337159 (+ 2949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:24.337165 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:24.337168 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:24.337210 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:24.338925 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:24.339494 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:24.339496 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:24.339497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:24.339580 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:24.339835 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:24.339837 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:24.339839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:24.340040 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:24.340145 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:24.340434 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 05:03:24.340540 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 05:03:24.344153 24618 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49100:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:03:24.347429 24618 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:24.363435 25173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.356744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39086 (local address 127.22.49.195:35751)
0811 05:03:24.358078 (+ 1334us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:24.358092 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:24.358119 (+ 27us) server_negotiation.cc:407] Connection header received
0811 05:03:24.358201 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:24.358208 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:24.358424 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:24.358583 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:24.358911 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.360220 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.362069 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.362623 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.362761 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.362961 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:24.363161 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 05:03:24.363263 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1232,"thread_start_us":175,"threads_started":1}
I20260811 05:03:24.363425 25174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.356608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:35751 (local address 127.0.0.1:39086)
0811 05:03:24.357405 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:24.357459 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:24.357605 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:24.358589 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:24.358598 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:24.358626 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:24.358776 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.358784 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.360376 (+ 1592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.360382 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.361924 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.361935 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.362765 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.362769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.362895 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.362937 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 05:03:24.363109 (+ 172us) client_negotiation.cc:240] Negotiation successful
0811 05:03:24.363261 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"mutex_wait_us":155,"thread_start_us":92,"threads_started":1}
I20260811 05:03:24.363744 25172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.356635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:39553 (local address 127.0.0.1:54656)
0811 05:03:24.357946 (+ 1311us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:24.357959 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:24.358057 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:24.358902 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:24.358904 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:24.358918 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:24.359065 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.359073 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.360446 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.360449 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.361878 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.361889 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.363072 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.363075 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.363340 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.363421 (+ 81us) client_negotiation.cc:769] Sending connection context
0811 05:03:24.363495 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 05:03:24.363605 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1244,"mutex_wait_us":222,"thread_start_us":102,"threads_started":1}
I20260811 05:03:24.363896 25176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.357446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32870 (local address 127.22.49.194:38129)
0811 05:03:24.357970 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:24.357983 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:24.358225 (+ 242us) server_negotiation.cc:407] Connection header received
0811 05:03:24.358368 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:24.358378 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:24.358550 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:24.358693 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:24.359048 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.359855 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.361763 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.362649 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.362762 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.362962 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:24.363639 (+ 677us) server_negotiation.cc:299] Negotiation successful
0811 05:03:24.363737 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":106,"threads_started":1}
I20260811 05:03:24.364248 25175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.357432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54656 (local address 127.22.49.193:39553)
0811 05:03:24.357844 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:24.357852 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:24.358152 (+ 300us) server_negotiation.cc:407] Connection header received
0811 05:03:24.358222 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:24.358227 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:24.358424 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:24.358583 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:24.359219 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.360327 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.362019 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.362771 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.362871 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.363014 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:24.363956 (+ 942us) server_negotiation.cc:299] Negotiation successful
0811 05:03:24.364076 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":100,"threads_started":1}
I20260811 05:03:24.364845 25171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.357030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38129 (local address 127.0.0.1:32870)
0811 05:03:24.358127 (+ 1097us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:24.358138 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:24.358251 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:24.358746 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:24.358749 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:24.358774 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:24.358902 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.358908 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.360043 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.360046 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.361622 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.361633 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.363072 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.363076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.363342 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.363423 (+ 81us) client_negotiation.cc:769] Sending connection context
0811 05:03:24.363495 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 05:03:24.364717 (+ 1222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1031,"mutex_wait_us":1358,"thread_start_us":88,"threads_started":1}
I20260811 05:03:24.367511 25081 tablet_service.cc:1467] Processing CreateTablet for tablet 5f5ddfeeda244737ada7bf13ba01a195 (DEFAULT_TABLE table=test-table [id=018ec5b6c9264107a7ca9ad4a1ea9f62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:24.367784 24928 tablet_service.cc:1467] Processing CreateTablet for tablet 5f5ddfeeda244737ada7bf13ba01a195 (DEFAULT_TABLE table=test-table [id=018ec5b6c9264107a7ca9ad4a1ea9f62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:24.368722 24928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f5ddfeeda244737ada7bf13ba01a195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:24.368743 25081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f5ddfeeda244737ada7bf13ba01a195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:24.369040 24775 tablet_service.cc:1467] Processing CreateTablet for tablet 5f5ddfeeda244737ada7bf13ba01a195 (DEFAULT_TABLE table=test-table [id=018ec5b6c9264107a7ca9ad4a1ea9f62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:24.370138 24775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f5ddfeeda244737ada7bf13ba01a195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:24.375641 25177 tablet_bootstrap.cc:492] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e: Bootstrap starting.
I20260811 05:03:24.377130 25178 tablet_bootstrap.cc:492] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6: Bootstrap starting.
I20260811 05:03:24.378585 25177 tablet_bootstrap.cc:654] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:24.379415 25178 tablet_bootstrap.cc:654] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:24.379766 25177 log.cc:824] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:24.380314 25178 log.cc:824] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:24.380795 25179 tablet_bootstrap.cc:492] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca: Bootstrap starting.
I20260811 05:03:24.382212 25177 tablet_bootstrap.cc:492] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e: No bootstrap required, opened a new log
I20260811 05:03:24.382409 25178 tablet_bootstrap.cc:492] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6: No bootstrap required, opened a new log
I20260811 05:03:24.382443 25177 ts_tablet_manager.cc:1397] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 05:03:24.382606 25178 ts_tablet_manager.cc:1397] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 05:03:24.383633 25179 tablet_bootstrap.cc:654] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:24.384684 25179 log.cc:824] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:24.386747 25177 raft_consensus.cc:348] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } }
I20260811 05:03:24.386747 25178 raft_consensus.cc:348] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } }
I20260811 05:03:24.387068 25177 raft_consensus.cc:374] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:24.387071 25178 raft_consensus.cc:374] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:24.387125 25177 raft_consensus.cc:729] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fad92cafead4c48ac222b29a79a266e, State: Initialized, Role: FOLLOWER
I20260811 05:03:24.387126 25178 raft_consensus.cc:729] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7f38305e0a4f799bc4512ec4d83ea6, State: Initialized, Role: FOLLOWER
I20260811 05:03:24.387135 25179 tablet_bootstrap.cc:492] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca: No bootstrap required, opened a new log
I20260811 05:03:24.387341 25179 ts_tablet_manager.cc:1397] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 05:03:24.387630 25178 consensus_queue.cc:260] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } }
I20260811 05:03:24.387630 25177 consensus_queue.cc:260] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } }
I20260811 05:03:24.388684 25177 ts_tablet_manager.cc:1428] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 05:03:24.388715 25178 ts_tablet_manager.cc:1428] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 05:03:24.389062 25002 heartbeater.cc:503] Master 127.22.49.254:42089 was elected leader, sending a full tablet report...
I20260811 05:03:24.389089 25154 heartbeater.cc:503] Master 127.22.49.254:42089 was elected leader, sending a full tablet report...
I20260811 05:03:24.392180 25179 raft_consensus.cc:348] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } }
I20260811 05:03:24.392499 25179 raft_consensus.cc:374] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:24.392619 25179 raft_consensus.cc:729] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c2ac2a0e9fb4eec98b1410f576345ca, State: Initialized, Role: FOLLOWER
I20260811 05:03:24.393180 25179 consensus_queue.cc:260] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } }
I20260811 05:03:24.394423 25179 ts_tablet_manager.cc:1428] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 05:03:24.394848 24846 heartbeater.cc:503] Master 127.22.49.254:42089 was elected leader, sending a full tablet report...
W20260811 05:03:24.509068 24847 tablet.cc:2369] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:03:24.532394 25003 tablet.cc:2369] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:03:24.552335 25155 tablet.cc:2369] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:03:24.586364 25186 raft_consensus.cc:482] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:24.586606 25186 raft_consensus.cc:504] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } }
I20260811 05:03:24.588055 25186 leader_election.cc:288] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb7f38305e0a4f799bc4512ec4d83ea6 (127.22.49.195:35751), 1fad92cafead4c48ac222b29a79a266e (127.22.49.194:38129)
I20260811 05:03:24.592708 25173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.588409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:59821 (local address 127.22.49.195:35751)
0811 05:03:24.588583 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:24.588591 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:24.588900 (+ 309us) server_negotiation.cc:407] Connection header received
0811 05:03:24.589099 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:24.589102 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:24.589148 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:24.589240 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:24.589579 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.590098 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.591466 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.592049 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.592235 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.592305 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:24.592493 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 05:03:24.592572 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 05:03:24.592775 25189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.588270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:35751 (local address 127.22.49.193:59821)
0811 05:03:24.588772 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:24.588794 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:24.588950 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:24.589280 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:24.589283 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:24.589327 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:24.589455 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.589462 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.590221 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.590227 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.591207 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.591344 (+ 137us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.592230 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.592234 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.592338 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.592367 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 05:03:24.592456 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 05:03:24.592547 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425,"mutex_wait_us":73,"spinlock_wait_cycles":24064,"thread_start_us":161,"threads_started":1}
I20260811 05:03:24.592809 25188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.588409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38129 (local address 127.22.49.193:55155)
0811 05:03:24.588816 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:24.588828 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:24.588967 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:24.589255 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:24.589258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:24.589275 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:24.589433 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.589439 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.590207 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.590211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.591398 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.591410 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.592306 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.592310 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.592438 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.592455 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 05:03:24.592545 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 05:03:24.592627 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"mutex_wait_us":1,"spinlock_wait_cycles":2944,"thread_start_us":130,"threads_started":1}
I20260811 05:03:24.592788 25176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.588552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:55155 (local address 127.22.49.194:38129)
0811 05:03:24.588689 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:24.588694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:24.588933 (+ 239us) server_negotiation.cc:407] Connection header received
0811 05:03:24.589093 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:24.589098 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:24.589146 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:24.589240 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:24.589554 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.590080 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.591726 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.592162 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.592306 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.592365 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:24.592575 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 05:03:24.592657 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 05:03:24.593578 25090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f5ddfeeda244737ada7bf13ba01a195" candidate_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" is_pre_election: true
I20260811 05:03:24.593734 24949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f5ddfeeda244737ada7bf13ba01a195" candidate_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fad92cafead4c48ac222b29a79a266e" is_pre_election: true
I20260811 05:03:24.593976 25090 raft_consensus.cc:2454] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c2ac2a0e9fb4eec98b1410f576345ca in term 0.
I20260811 05:03:24.594043 24949 raft_consensus.cc:2454] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c2ac2a0e9fb4eec98b1410f576345ca in term 0.
I20260811 05:03:24.594586 24716 leader_election.cc:302] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c2ac2a0e9fb4eec98b1410f576345ca, eb7f38305e0a4f799bc4512ec4d83ea6; no voters:
I20260811 05:03:24.594939 25186 raft_consensus.cc:2781] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:24.595054 25186 raft_consensus.cc:482] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:24.595103 25186 raft_consensus.cc:3037] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:24.596282 25186 raft_consensus.cc:504] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } }
I20260811 05:03:24.596694 25186 leader_election.cc:288] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [CANDIDATE]: Term 1 election: Requested vote from peers eb7f38305e0a4f799bc4512ec4d83ea6 (127.22.49.195:35751), 1fad92cafead4c48ac222b29a79a266e (127.22.49.194:38129)
I20260811 05:03:24.597098 25090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f5ddfeeda244737ada7bf13ba01a195" candidate_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6"
I20260811 05:03:24.597144 24949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f5ddfeeda244737ada7bf13ba01a195" candidate_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fad92cafead4c48ac222b29a79a266e"
I20260811 05:03:24.597285 24949 raft_consensus.cc:3037] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:24.597265 25090 raft_consensus.cc:3037] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:24.598819 24949 raft_consensus.cc:2454] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c2ac2a0e9fb4eec98b1410f576345ca in term 1.
I20260811 05:03:24.599040 25090 raft_consensus.cc:2454] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c2ac2a0e9fb4eec98b1410f576345ca in term 1.
I20260811 05:03:24.599491 24718 leader_election.cc:302] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c2ac2a0e9fb4eec98b1410f576345ca, 1fad92cafead4c48ac222b29a79a266e; no voters:
I20260811 05:03:24.599857 25186 raft_consensus.cc:2781] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:24.600155 25186 raft_consensus.cc:686] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 LEADER]: Becoming Leader. State: Replica: 1c2ac2a0e9fb4eec98b1410f576345ca, State: Running, Role: LEADER
I20260811 05:03:24.600692 25186 consensus_queue.cc:237] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } }
I20260811 05:03:24.604760 24618 catalog_manager.cc:5495] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c2ac2a0e9fb4eec98b1410f576345ca (127.22.49.193). New cstate: current_term: 1 leader_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } health_report { overall_health: UNKNOWN } } }
Aug 11 05:03:24 dist-test-slave-w206 krb5kdc[24570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424603, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:24.694896 24672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.685133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49108 (local address 127.22.49.254:42089)
0811 05:03:24.685367 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:24.685372 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:24.685519 (+ 147us) server_negotiation.cc:407] Connection header received
0811 05:03:24.685688 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:24.685690 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:24.685733 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:24.685826 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:24.686531 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.687121 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.687941 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.688144 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.688250 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.690903 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:24.690906 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:24.690909 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:24.690932 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:24.692635 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:24.693312 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:24.693316 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:24.693318 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:24.693520 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:24.693932 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:24.693934 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:24.693936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:24.694154 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:24.694236 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:24.694635 (+ 399us) server_negotiation.cc:299] Negotiation successful
0811 05:03:24.694761 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 05:03:24.695201 25198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.685071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:42089 (local address 127.0.0.1:49108)
0811 05:03:24.685403 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:24.685419 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:24.685583 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:24.685843 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:24.685846 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:24.686299 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:24.686392 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.686399 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.687229 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.687235 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.687811 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.687818 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.688260 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.688264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.688332 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.688997 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:24.689009 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:24.690712 (+ 1703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:24.692782 (+ 2070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:24.692795 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:24.692802 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:24.693190 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:24.693653 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:24.693656 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:24.693658 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:24.693819 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:24.694288 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:24.694294 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:24.694431 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 05:03:24.694586 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 05:03:24.694871 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"mutex_wait_us":87,"thread_start_us":116,"threads_started":1}
I20260811 05:03:24.699903 24618 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:49108:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 05:03:24.700752 24618 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:24.706187 25081 tablet_service.cc:1467] Processing CreateTablet for tablet 5c6d4f55317b4041895f6b03bf2e8222 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=227039a0a7f94bc9b30f89b6379426ce]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:03:24.705989 24928 tablet_service.cc:1467] Processing CreateTablet for tablet 5c6d4f55317b4041895f6b03bf2e8222 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=227039a0a7f94bc9b30f89b6379426ce]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:03:24.705989 24775 tablet_service.cc:1467] Processing CreateTablet for tablet 5c6d4f55317b4041895f6b03bf2e8222 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=227039a0a7f94bc9b30f89b6379426ce]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:03:24.706828 24928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c6d4f55317b4041895f6b03bf2e8222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:24.706845 24775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c6d4f55317b4041895f6b03bf2e8222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:24.706861 25081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c6d4f55317b4041895f6b03bf2e8222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:24.710136 25177 tablet_bootstrap.cc:492] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e: Bootstrap starting.
I20260811 05:03:24.710546 25178 tablet_bootstrap.cc:492] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6: Bootstrap starting.
I20260811 05:03:24.711185 25179 tablet_bootstrap.cc:492] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca: Bootstrap starting.
I20260811 05:03:24.711357 25177 tablet_bootstrap.cc:654] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:24.711686 25178 tablet_bootstrap.cc:654] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:24.712779 25179 tablet_bootstrap.cc:654] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:24.713181 25177 tablet_bootstrap.cc:492] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e: No bootstrap required, opened a new log
I20260811 05:03:24.713228 25178 tablet_bootstrap.cc:492] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6: No bootstrap required, opened a new log
I20260811 05:03:24.713312 25177 ts_tablet_manager.cc:1397] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:24.713317 25178 ts_tablet_manager.cc:1397] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:24.713817 25178 raft_consensus.cc:348] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:24.713932 25178 raft_consensus.cc:374] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:24.713817 25177 raft_consensus.cc:348] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:24.713954 25178 raft_consensus.cc:729] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7f38305e0a4f799bc4512ec4d83ea6, State: Initialized, Role: FOLLOWER
I20260811 05:03:24.714022 25177 raft_consensus.cc:374] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:24.714074 25177 raft_consensus.cc:729] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fad92cafead4c48ac222b29a79a266e, State: Initialized, Role: FOLLOWER
I20260811 05:03:24.714120 25178 consensus_queue.cc:260] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:24.714206 25177 consensus_queue.cc:260] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:24.714529 25178 ts_tablet_manager.cc:1428] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 05:03:24.714483 25183 tablet_replica.cc:439] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } }
I20260811 05:03:24.714612 25177 ts_tablet_manager.cc:1428] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:24.714673 25183 tablet_replica.cc:442] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:24.714823 25185 tablet_replica.cc:439] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } }
I20260811 05:03:24.714967 25185 tablet_replica.cc:442] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:24.716301 25179 tablet_bootstrap.cc:492] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca: No bootstrap required, opened a new log
I20260811 05:03:24.716444 25179 ts_tablet_manager.cc:1397] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 05:03:24.717010 25179 raft_consensus.cc:348] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:24.717113 25179 raft_consensus.cc:374] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:24.717133 25179 raft_consensus.cc:729] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c2ac2a0e9fb4eec98b1410f576345ca, State: Initialized, Role: FOLLOWER
I20260811 05:03:24.717275 25179 consensus_queue.cc:260] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:24.717581 25179 ts_tablet_manager.cc:1428] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 05:03:24.717543 25186 tablet_replica.cc:439] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } }
I20260811 05:03:24.717675 25186 tablet_replica.cc:442] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:24.963934 25185 raft_consensus.cc:482] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:24.964174 25185 raft_consensus.cc:504] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:24.965632 25185 leader_election.cc:288] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c2ac2a0e9fb4eec98b1410f576345ca (127.22.49.193:39553), eb7f38305e0a4f799bc4512ec4d83ea6 (127.22.49.195:35751)
I20260811 05:03:24.969623 25183 raft_consensus.cc:482] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:24.969784 25183 raft_consensus.cc:504] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:24.970855 25202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.966018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:35751 (local address 127.22.49.194:45035)
0811 05:03:24.966384 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:24.966411 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:24.966604 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:24.966935 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:24.966941 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:24.966960 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:24.967114 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.967128 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.968216 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.968219 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.969452 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.969463 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.970365 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.970369 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.970484 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.970512 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 05:03:24.970600 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 05:03:24.970684 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":102,"threads_started":1}
I20260811 05:03:24.970860 25173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.966105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:45035 (local address 127.22.49.195:35751)
0811 05:03:24.966267 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:24.966272 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:24.966536 (+ 264us) server_negotiation.cc:407] Connection header received
0811 05:03:24.966740 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:24.966745 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:24.966814 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:24.966894 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:24.967254 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.968100 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.969619 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.970196 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.970344 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.970406 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:24.970642 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 05:03:24.970727 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 05:03:24.971323 25183 leader_election.cc:288] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c2ac2a0e9fb4eec98b1410f576345ca (127.22.49.193:39553), 1fad92cafead4c48ac222b29a79a266e (127.22.49.194:38129)
I20260811 05:03:24.971398 25090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c6d4f55317b4041895f6b03bf2e8222" candidate_uuid: "1fad92cafead4c48ac222b29a79a266e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" is_pre_election: true
I20260811 05:03:24.971561 25090 raft_consensus.cc:2454] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fad92cafead4c48ac222b29a79a266e in term 0.
I20260811 05:03:24.972147 25203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.966018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:39553 (local address 127.22.49.194:47757)
0811 05:03:24.966445 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:24.966459 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:24.966639 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:24.967016 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:24.967019 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:24.967042 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:24.967804 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.967817 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.969040 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.969042 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.970083 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.970096 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.971574 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.971580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.971756 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.971785 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 05:03:24.971860 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 05:03:24.971960 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":30,"thread_start_us":65,"threads_started":1}
I20260811 05:03:24.972710 25204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.966105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:47757 (local address 127.22.49.193:39553)
0811 05:03:24.966479 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:24.966486 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:24.966582 (+ 96us) server_negotiation.cc:407] Connection header received
0811 05:03:24.966790 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:24.966793 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:24.966857 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:24.966954 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:24.968012 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.968901 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.970237 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.970855 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.971387 (+ 532us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.972432 (+ 1045us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:24.972476 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 05:03:24.972573 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":75,"threads_started":1}
I20260811 05:03:24.972278 24871 leader_election.cc:302] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fad92cafead4c48ac222b29a79a266e, eb7f38305e0a4f799bc4512ec4d83ea6; no voters:
I20260811 05:03:24.973193 25185 raft_consensus.cc:2781] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:24.973265 25185 raft_consensus.cc:482] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:24.973306 25185 raft_consensus.cc:3037] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:24.974630 25185 raft_consensus.cc:504] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:24.975100 25185 leader_election.cc:288] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [CANDIDATE]: Term 1 election: Requested vote from peers 1c2ac2a0e9fb4eec98b1410f576345ca (127.22.49.193:39553), eb7f38305e0a4f799bc4512ec4d83ea6 (127.22.49.195:35751)
I20260811 05:03:24.975587 25090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c6d4f55317b4041895f6b03bf2e8222" candidate_uuid: "1fad92cafead4c48ac222b29a79a266e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6"
I20260811 05:03:24.975719 25090 raft_consensus.cc:3037] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:24.975821 24795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c6d4f55317b4041895f6b03bf2e8222" candidate_uuid: "1fad92cafead4c48ac222b29a79a266e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" is_pre_election: true
I20260811 05:03:24.976099 24795 raft_consensus.cc:2454] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fad92cafead4c48ac222b29a79a266e in term 0.
I20260811 05:03:24.976492 24794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c6d4f55317b4041895f6b03bf2e8222" candidate_uuid: "1fad92cafead4c48ac222b29a79a266e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca"
I20260811 05:03:24.976631 24794 raft_consensus.cc:3037] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:24.976883 25208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.972469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:59275 (local address 127.22.49.193:39553)
0811 05:03:24.972714 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:24.972719 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:24.972734 (+ 15us) server_negotiation.cc:407] Connection header received
0811 05:03:24.972778 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:24.972780 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:24.972838 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:24.972928 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:24.973324 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.974091 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.975550 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.976199 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.976323 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.976373 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:24.976623 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 05:03:24.976721 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":92,"threads_started":1}
I20260811 05:03:24.977080 25090 raft_consensus.cc:2454] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fad92cafead4c48ac222b29a79a266e in term 1.
I20260811 05:03:24.977303 25205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.971611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:39553 (local address 127.22.49.195:59275)
0811 05:03:24.971871 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:24.971888 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:24.971992 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:24.973043 (+ 1051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:24.973046 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:24.973064 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:24.973184 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.973193 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.974227 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.974231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.975398 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.975407 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.976340 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.976344 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.976460 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.976490 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 05:03:24.976579 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 05:03:24.976784 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":99,"threads_started":1}
I20260811 05:03:24.977620 24871 leader_election.cc:302] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fad92cafead4c48ac222b29a79a266e, eb7f38305e0a4f799bc4512ec4d83ea6; no voters:
I20260811 05:03:24.977865 25185 raft_consensus.cc:2781] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:24.978116 25185 raft_consensus.cc:686] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [term 1 LEADER]: Becoming Leader. State: Replica: 1fad92cafead4c48ac222b29a79a266e, State: Running, Role: LEADER
I20260811 05:03:24.978125 24794 raft_consensus.cc:2454] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fad92cafead4c48ac222b29a79a266e in term 1.
I20260811 05:03:24.978526 25185 consensus_queue.cc:237] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:24.978880 24794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c6d4f55317b4041895f6b03bf2e8222" candidate_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" is_pre_election: true
I20260811 05:03:24.979185 24794 raft_consensus.cc:2379] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb7f38305e0a4f799bc4512ec4d83ea6 in current term 1: Already voted for candidate 1fad92cafead4c48ac222b29a79a266e in this term.
I20260811 05:03:24.979471 25176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.972068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:58309 (local address 127.22.49.194:38129)
0811 05:03:24.972189 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:24.972195 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:24.972211 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:03:24.972260 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:24.972262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:24.972300 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:24.972386 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:24.972646 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.973378 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.974741 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.975360 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.975485 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.975536 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:24.979236 (+ 3700us) server_negotiation.cc:299] Negotiation successful
0811 05:03:24.979327 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 05:03:24.979907 25207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:24.971639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38129 (local address 127.22.49.195:58309)
0811 05:03:24.972073 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:24.972086 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:24.972154 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:24.972410 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:24.972413 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:24.972429 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:24.972527 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.972535 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.973534 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.973538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.974597 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:24.974607 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:24.978923 (+ 4316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:24.978927 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:24.979089 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:24.979122 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 05:03:24.979219 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 05:03:24.979375 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":79,"threads_started":1}
I20260811 05:03:24.980782 24949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c6d4f55317b4041895f6b03bf2e8222" candidate_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fad92cafead4c48ac222b29a79a266e" is_pre_election: true
I20260811 05:03:24.981506 25028 leader_election.cc:302] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb7f38305e0a4f799bc4512ec4d83ea6; no voters: 1c2ac2a0e9fb4eec98b1410f576345ca, 1fad92cafead4c48ac222b29a79a266e
I20260811 05:03:24.981863 25183 raft_consensus.cc:2726] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 05:03:24.982664 25209 tablet_replica.cc:439] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e: TxnStatusTablet state changed. Reason: New leader 1fad92cafead4c48ac222b29a79a266e. Latest consensus state: current_term: 1 leader_uuid: "1fad92cafead4c48ac222b29a79a266e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } }
I20260811 05:03:24.982802 25209 tablet_replica.cc:442] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:03:24.983157 25211 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 05:03:24.983374 25211 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 05:03:24.983354 24614 catalog_manager.cc:5495] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fad92cafead4c48ac222b29a79a266e (127.22.49.194). New cstate: current_term: 1 leader_uuid: "1fad92cafead4c48ac222b29a79a266e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } health_report { overall_health: UNKNOWN } } }
I20260811 05:03:25.015292 25198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:25.009619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38129 (local address 127.0.0.1:32874)
0811 05:03:25.009904 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:25.009920 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:25.010054 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:25.010697 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:25.010700 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:25.010707 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:03:25.010806 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:25.010811 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.011982 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.011985 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:25.012634 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:25.012647 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.013598 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.013601 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:25.013709 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:25.013785 (+ 76us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:03:25.014854 (+ 1069us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:03:25.014875 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 05:03:25.014953 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 05:03:25.015116 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167}
I20260811 05:03:25.015377 25176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:25.009735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32874 (local address 127.22.49.194:38129)
0811 05:03:25.009882 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:25.009888 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:25.010013 (+ 125us) server_negotiation.cc:407] Connection header received
0811 05:03:25.010254 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:25.010261 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:25.010350 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:25.010474 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:25.010936 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.011853 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.012951 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.013322 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.013435 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:25.013989 (+ 554us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:25.014677 (+ 688us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:25.014790 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:25.015090 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 05:03:25.015188 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 05:03:25.022377 24794 raft_consensus.cc:1261] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 FOLLOWER]: Refusing update from remote peer 1fad92cafead4c48ac222b29a79a266e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:25.022423 25090 raft_consensus.cc:1261] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Refusing update from remote peer 1fad92cafead4c48ac222b29a79a266e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:25.023134 25209 consensus_queue.cc:1035] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:25.023358 25185 consensus_queue.cc:1035] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:25.027885 25186 tablet_replica.cc:439] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca: TxnStatusTablet state changed. Reason: New leader 1fad92cafead4c48ac222b29a79a266e. Latest consensus state: current_term: 1 leader_uuid: "1fad92cafead4c48ac222b29a79a266e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } }
I20260811 05:03:25.028098 25186 tablet_replica.cc:442] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:25.028762 25183 tablet_replica.cc:439] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6: TxnStatusTablet state changed. Reason: New leader 1fad92cafead4c48ac222b29a79a266e. Latest consensus state: current_term: 1 leader_uuid: "1fad92cafead4c48ac222b29a79a266e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } }
I20260811 05:03:25.028908 25183 tablet_replica.cc:442] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:25.031555 25209 tablet_replica.cc:439] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1fad92cafead4c48ac222b29a79a266e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } }
I20260811 05:03:25.031693 25209 tablet_replica.cc:442] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:03:25.032212 25209 tablet_replica.cc:439] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1fad92cafead4c48ac222b29a79a266e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } }
I20260811 05:03:25.032321 25209 tablet_replica.cc:442] T 5c6d4f55317b4041895f6b03bf2e8222 P 1fad92cafead4c48ac222b29a79a266e: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:03:25.032553 25186 tablet_replica.cc:439] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1fad92cafead4c48ac222b29a79a266e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } }
I20260811 05:03:25.032671 25186 tablet_replica.cc:442] T 5c6d4f55317b4041895f6b03bf2e8222 P 1c2ac2a0e9fb4eec98b1410f576345ca: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:25.033406 25183 tablet_replica.cc:439] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1fad92cafead4c48ac222b29a79a266e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } } }
I20260811 05:03:25.033532 25183 tablet_replica.cc:442] T 5c6d4f55317b4041895f6b03bf2e8222 P eb7f38305e0a4f799bc4512ec4d83ea6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:25.033861 25216 mvcc.cc:205] Tried to move back new op lower bound from 7317195182163546112 to 7317195181996994560. Current Snapshot: MvccSnapshot[applied={T|T < 7317195182163546112}]
I20260811 05:03:25.037596 25215 mvcc.cc:205] Tried to move back new op lower bound from 7317195182163546112 to 7317195181996994560. Current Snapshot: MvccSnapshot[applied={T|T < 7317195182163546112}]
I20260811 05:03:25.054740 25208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:25.050056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54664 (local address 127.22.49.193:39553)
0811 05:03:25.050241 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:25.050244 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:25.050382 (+ 138us) server_negotiation.cc:407] Connection header received
0811 05:03:25.050562 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:25.050565 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:25.050627 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:25.050726 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:25.051077 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.051626 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.052934 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.053183 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.053282 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:25.053656 (+ 374us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:25.054229 (+ 573us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:25.054327 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:25.054484 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 05:03:25.054549 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260811 05:03:25.068847 25176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:25.064383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:53057 (local address 127.22.49.194:38129)
0811 05:03:25.064547 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:25.064552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:25.064765 (+ 213us) server_negotiation.cc:407] Connection header received
0811 05:03:25.064891 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:25.064894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:25.064941 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:25.065010 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:25.065420 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.066153 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.067498 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.067809 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.067927 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:25.068312 (+ 385us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:25.068395 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:25.068457 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:25.068622 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 05:03:25.068687 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 05:03:25.068881 25227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:25.064228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38129 (local address 127.22.49.193:53057)
0811 05:03:25.064656 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:25.064673 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:25.064796 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:25.065053 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:25.065056 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:25.065064 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:03:25.065216 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:25.065222 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.066287 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.066291 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:25.067330 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:25.067342 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.067945 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.067949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:25.068056 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:25.068124 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:03:25.068490 (+ 366us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:03:25.068497 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 05:03:25.068567 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 05:03:25.068688 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":184,"threads_started":1}
I20260811 05:03:25.078717 25090 raft_consensus.cc:1261] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Refusing update from remote peer 1c2ac2a0e9fb4eec98b1410f576345ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:25.078737 24949 raft_consensus.cc:1261] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Refusing update from remote peer 1c2ac2a0e9fb4eec98b1410f576345ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:25.079344 25190 consensus_queue.cc:1035] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:25.079545 25186 consensus_queue.cc:1035] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:25.091073 25214 mvcc.cc:205] Tried to move back new op lower bound from 7317195182396727296 to 7317195180447752192. Current Snapshot: MvccSnapshot[applied={T|T < 7317195182396727296}]
I20260811 05:03:25.106624 25208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:25.102663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:50911 (local address 127.22.49.193:39553)
0811 05:03:25.102781 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:25.102786 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:25.103012 (+ 226us) server_negotiation.cc:407] Connection header received
0811 05:03:25.103157 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:25.103160 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:25.103216 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:25.103308 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:25.103650 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.104179 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.105459 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.105678 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.105790 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:25.106089 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:25.106166 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:25.106270 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:25.106410 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 05:03:25.106469 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 05:03:25.106638 25234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:25.102550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:39553 (local address 127.22.49.194:50911)
0811 05:03:25.102893 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:25.102908 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:25.103062 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:25.103325 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:25.103328 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:25.103335 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:03:25.103477 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:25.103484 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.104300 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.104306 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:25.105325 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:25.105336 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.105798 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.105802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:25.105886 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:25.105941 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:03:25.106318 (+ 377us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:03:25.106325 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 05:03:25.106387 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 05:03:25.106478 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":130,"threads_started":1}
I20260811 05:03:25.137823 24618 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:25.138056 24618 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:25.141464 24618 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394: Sending DeleteTablet for 3 replicas of tablet 5f5ddfeeda244737ada7bf13ba01a195
I20260811 05:03:25.142601 25081 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f5ddfeeda244737ada7bf13ba01a195 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:25 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:39086
I20260811 05:03:25.142724 24928 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f5ddfeeda244737ada7bf13ba01a195 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:25 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:32870
I20260811 05:03:25.143486 25239 tablet_replica.cc:330] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e: stopping tablet replica
I20260811 05:03:25.143474 24775 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f5ddfeeda244737ada7bf13ba01a195 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:25 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:54656
I20260811 05:03:25.143966 25239 raft_consensus.cc:2229] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:25.144230 25239 raft_consensus.cc:2258] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:25.145148 24618 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49100:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:03:25.145686 24618 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:25.146198 25239 ts_tablet_manager.cc:1905] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:25.149942 25239 ts_tablet_manager.cc:1918] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:03:25.150204 25239 log.cc:1196] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/5f5ddfeeda244737ada7bf13ba01a195
I20260811 05:03:25.150673 25239 ts_tablet_manager.cc:1939] T 5f5ddfeeda244737ada7bf13ba01a195 P 1fad92cafead4c48ac222b29a79a266e: Deleting consensus metadata
I20260811 05:03:25.152313 24928 tablet_service.cc:1467] Processing CreateTablet for tablet 7aa1a5d22d7644e0a5d4e7c00e1044bb (DEFAULT_TABLE table=test-table [id=8529a9b5259d404da9a3ce6b8773eacf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:25.152629 24928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aa1a5d22d7644e0a5d4e7c00e1044bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:25.152608 24601 catalog_manager.cc:4841] TS 1fad92cafead4c48ac222b29a79a266e (127.22.49.194:38129): tablet 5f5ddfeeda244737ada7bf13ba01a195 (table test-table [id=018ec5b6c9264107a7ca9ad4a1ea9f62]) successfully deleted
I20260811 05:03:25.153103 24775 tablet_service.cc:1467] Processing CreateTablet for tablet 7aa1a5d22d7644e0a5d4e7c00e1044bb (DEFAULT_TABLE table=test-table [id=8529a9b5259d404da9a3ce6b8773eacf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:25.153430 24775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aa1a5d22d7644e0a5d4e7c00e1044bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:25.155407 25177 tablet_bootstrap.cc:492] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e: Bootstrap starting.
I20260811 05:03:25.156136 25179 tablet_bootstrap.cc:492] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca: Bootstrap starting.
I20260811 05:03:25.156495 25177 tablet_bootstrap.cc:654] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:25.157183 25179 tablet_bootstrap.cc:654] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:25.157677 25081 tablet_service.cc:1467] Processing CreateTablet for tablet 7aa1a5d22d7644e0a5d4e7c00e1044bb (DEFAULT_TABLE table=test-table [id=8529a9b5259d404da9a3ce6b8773eacf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:25.157976 25081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7aa1a5d22d7644e0a5d4e7c00e1044bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:25.158357 25240 tablet_replica.cc:330] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca: stopping tablet replica
I20260811 05:03:25.158771 25240 raft_consensus.cc:2229] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:03:25.159209 25240 raft_consensus.cc:2258] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:25.161309 25178 tablet_bootstrap.cc:492] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6: Bootstrap starting.
I20260811 05:03:25.161859 25240 ts_tablet_manager.cc:1905] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:25.162482 25178 tablet_bootstrap.cc:654] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:25.163280 25237 tablet_replica.cc:330] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6: stopping tablet replica
I20260811 05:03:25.163722 25237 raft_consensus.cc:2229] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:25.163983 25237 raft_consensus.cc:2258] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:25.165067 25177 tablet_bootstrap.cc:492] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e: No bootstrap required, opened a new log
I20260811 05:03:25.165192 25177 ts_tablet_manager.cc:1397] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260811 05:03:25.165985 25177 raft_consensus.cc:348] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:25.166174 25177 raft_consensus.cc:374] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:25.166219 25177 raft_consensus.cc:729] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fad92cafead4c48ac222b29a79a266e, State: Initialized, Role: FOLLOWER
I20260811 05:03:25.166410 25177 consensus_queue.cc:260] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:25.166725 25177 ts_tablet_manager.cc:1428] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:25.167302 25237 ts_tablet_manager.cc:1905] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:25.169064 25178 tablet_bootstrap.cc:492] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6: No bootstrap required, opened a new log
I20260811 05:03:25.169183 25178 ts_tablet_manager.cc:1397] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260811 05:03:25.169878 25178 raft_consensus.cc:348] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:25.170044 25178 raft_consensus.cc:374] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:25.170081 25178 raft_consensus.cc:729] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7f38305e0a4f799bc4512ec4d83ea6, State: Initialized, Role: FOLLOWER
I20260811 05:03:25.170230 25178 consensus_queue.cc:260] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:25.170526 25178 ts_tablet_manager.cc:1428] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 05:03:25.175043 25179 tablet_bootstrap.cc:492] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca: No bootstrap required, opened a new log
I20260811 05:03:25.175174 25179 ts_tablet_manager.cc:1397] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20260811 05:03:25.175740 25179 raft_consensus.cc:348] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:25.175885 25179 raft_consensus.cc:374] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:25.175927 25179 raft_consensus.cc:729] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c2ac2a0e9fb4eec98b1410f576345ca, State: Initialized, Role: FOLLOWER
I20260811 05:03:25.176059 25179 consensus_queue.cc:260] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:25.176445 25179 ts_tablet_manager.cc:1428] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:25.173749 25240 ts_tablet_manager.cc:1918] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:03:25.179198 25240 log.cc:1196] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/wal/wals/5f5ddfeeda244737ada7bf13ba01a195
I20260811 05:03:25.179729 25237 ts_tablet_manager.cc:1918] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:03:25.179936 25237 log.cc:1196] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/5f5ddfeeda244737ada7bf13ba01a195
I20260811 05:03:25.180626 25240 ts_tablet_manager.cc:1939] T 5f5ddfeeda244737ada7bf13ba01a195 P 1c2ac2a0e9fb4eec98b1410f576345ca: Deleting consensus metadata
I20260811 05:03:25.180856 25237 ts_tablet_manager.cc:1939] T 5f5ddfeeda244737ada7bf13ba01a195 P eb7f38305e0a4f799bc4512ec4d83ea6: Deleting consensus metadata
I20260811 05:03:25.182648 24600 catalog_manager.cc:4841] TS eb7f38305e0a4f799bc4512ec4d83ea6 (127.22.49.195:35751): tablet 5f5ddfeeda244737ada7bf13ba01a195 (table test-table [id=018ec5b6c9264107a7ca9ad4a1ea9f62]) successfully deleted
I20260811 05:03:25.184094 24602 catalog_manager.cc:4841] TS 1c2ac2a0e9fb4eec98b1410f576345ca (127.22.49.193:39553): tablet 5f5ddfeeda244737ada7bf13ba01a195 (table test-table [id=018ec5b6c9264107a7ca9ad4a1ea9f62]) successfully deleted
I20260811 05:03:25.282608 25183 raft_consensus.cc:482] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:25.282763 25183 raft_consensus.cc:504] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:25.283353 25183 leader_election.cc:288] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c2ac2a0e9fb4eec98b1410f576345ca (127.22.49.193:39553), 1fad92cafead4c48ac222b29a79a266e (127.22.49.194:38129)
I20260811 05:03:25.283874 24949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa1a5d22d7644e0a5d4e7c00e1044bb" candidate_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fad92cafead4c48ac222b29a79a266e" is_pre_election: true
I20260811 05:03:25.283864 24794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa1a5d22d7644e0a5d4e7c00e1044bb" candidate_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" is_pre_election: true
I20260811 05:03:25.284050 24794 raft_consensus.cc:2454] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb7f38305e0a4f799bc4512ec4d83ea6 in term 0.
I20260811 05:03:25.284054 24949 raft_consensus.cc:2454] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb7f38305e0a4f799bc4512ec4d83ea6 in term 0.
I20260811 05:03:25.284413 25030 leader_election.cc:302] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c2ac2a0e9fb4eec98b1410f576345ca, eb7f38305e0a4f799bc4512ec4d83ea6; no voters:
I20260811 05:03:25.284600 25183 raft_consensus.cc:2781] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:25.284693 25183 raft_consensus.cc:482] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:25.284751 25183 raft_consensus.cc:3037] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:25.285933 25183 raft_consensus.cc:504] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:25.286309 25183 leader_election.cc:288] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [CANDIDATE]: Term 1 election: Requested vote from peers 1c2ac2a0e9fb4eec98b1410f576345ca (127.22.49.193:39553), 1fad92cafead4c48ac222b29a79a266e (127.22.49.194:38129)
I20260811 05:03:25.286737 24949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa1a5d22d7644e0a5d4e7c00e1044bb" candidate_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fad92cafead4c48ac222b29a79a266e"
I20260811 05:03:25.286876 24949 raft_consensus.cc:3037] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:25.286866 24794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7aa1a5d22d7644e0a5d4e7c00e1044bb" candidate_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca"
I20260811 05:03:25.287041 24794 raft_consensus.cc:3037] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:25.288146 24949 raft_consensus.cc:2454] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb7f38305e0a4f799bc4512ec4d83ea6 in term 1.
I20260811 05:03:25.288146 24794 raft_consensus.cc:2454] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb7f38305e0a4f799bc4512ec4d83ea6 in term 1.
I20260811 05:03:25.288496 25028 leader_election.cc:302] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fad92cafead4c48ac222b29a79a266e, eb7f38305e0a4f799bc4512ec4d83ea6; no voters:
I20260811 05:03:25.288654 25183 raft_consensus.cc:2781] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:25.288904 25183 raft_consensus.cc:686] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 LEADER]: Becoming Leader. State: Replica: eb7f38305e0a4f799bc4512ec4d83ea6, State: Running, Role: LEADER
I20260811 05:03:25.289170 25183 consensus_queue.cc:237] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:25.291755 24618 catalog_manager.cc:5495] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb7f38305e0a4f799bc4512ec4d83ea6 (127.22.49.195). New cstate: current_term: 1 leader_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } health_report { overall_health: HEALTHY } } }
I20260811 05:03:25.332042 25173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:25.328184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39102 (local address 127.22.49.195:35751)
0811 05:03:25.328304 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:25.328309 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:25.328340 (+ 31us) server_negotiation.cc:407] Connection header received
0811 05:03:25.328517 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:25.328520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:25.328599 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:25.328687 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:25.328946 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.329521 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.330365 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.330581 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.330662 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:25.331068 (+ 406us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:25.331553 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:25.331643 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:25.331783 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 05:03:25.331841 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 05:03:25.344085 25248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:25.340202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38129 (local address 127.22.49.195:49129)
0811 05:03:25.340782 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:25.340809 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:25.340958 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:25.341229 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:25.341232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:25.341240 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:03:25.341357 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:25.341363 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.342107 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.342111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:25.342741 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:25.342750 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.343250 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.343253 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:25.343341 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:25.343389 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:03:25.343720 (+ 331us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:03:25.343728 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 05:03:25.343832 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 05:03:25.343916 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":207,"threads_started":1}
I20260811 05:03:25.344070 25176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:25.340403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:49129 (local address 127.22.49.194:38129)
0811 05:03:25.340696 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:25.340701 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:25.340893 (+ 192us) server_negotiation.cc:407] Connection header received
0811 05:03:25.341067 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:25.341070 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:25.341124 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:25.341214 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:25.341466 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.341991 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.342880 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.343128 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.343243 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:25.343558 (+ 315us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:25.343632 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:25.343715 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:25.343845 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 05:03:25.343919 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190}
I20260811 05:03:25.350788 24794 raft_consensus.cc:1261] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 FOLLOWER]: Refusing update from remote peer eb7f38305e0a4f799bc4512ec4d83ea6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:25.350788 24949 raft_consensus.cc:1261] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Refusing update from remote peer eb7f38305e0a4f799bc4512ec4d83ea6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:25.351330 25244 consensus_queue.cc:1035] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:25.351588 25183 consensus_queue.cc:1035] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:25.369903 25173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:25.366684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:47565 (local address 127.22.49.195:35751)
0811 05:03:25.366792 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:25.366796 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:25.366807 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:03:25.366853 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:25.366855 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:25.366892 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:25.367061 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:25.367306 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.367911 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.368831 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.369064 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.369155 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:25.369409 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:25.369489 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:25.369548 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:25.369663 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 05:03:25.369749 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 05:03:25.369904 25234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:25.366473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:35751 (local address 127.22.49.194:47565)
0811 05:03:25.366592 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:25.366608 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:25.366692 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:25.367084 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:25.367087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:25.367094 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:03:25.367204 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:25.367210 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.368016 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.368019 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:25.368704 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:25.368713 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:25.369168 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:25.369173 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:25.369262 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:25.369295 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:03:25.369573 (+ 278us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:03:25.369580 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 05:03:25.369660 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 05:03:25.369751 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 05:03:25.370824 25215 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 05:03:26.949540 24619 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:26.949723 24619 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:26.953029 24619 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394: Sending DeleteTablet for 3 replicas of tablet 7aa1a5d22d7644e0a5d4e7c00e1044bb
I20260811 05:03:26.953908 24775 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa1a5d22d7644e0a5d4e7c00e1044bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:26 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:54656
I20260811 05:03:26.953938 25081 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa1a5d22d7644e0a5d4e7c00e1044bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:26 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:39086
I20260811 05:03:26.953910 24928 tablet_service.cc:1514] Processing DeleteTablet for tablet 7aa1a5d22d7644e0a5d4e7c00e1044bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:26 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:32870
I20260811 05:03:26.954336 25276 tablet_replica.cc:330] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e: stopping tablet replica
I20260811 05:03:26.954483 25276 raft_consensus.cc:2229] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:26.954624 25276 raft_consensus.cc:2258] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:26.954640 25275 tablet_replica.cc:330] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca: stopping tablet replica
I20260811 05:03:26.955029 25275 raft_consensus.cc:2229] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:26.955361 25275 raft_consensus.cc:2258] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:26.955639 25276 ts_tablet_manager.cc:1905] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:26.958952 25275 ts_tablet_manager.cc:1905] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:26.959267 25277 tablet_replica.cc:330] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6: stopping tablet replica
I20260811 05:03:26.959381 25276 ts_tablet_manager.cc:1918] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 05:03:26.959471 25276 log.cc:1196] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/7aa1a5d22d7644e0a5d4e7c00e1044bb
I20260811 05:03:26.959472 25277 raft_consensus.cc:2229] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:03:26.959774 25276 ts_tablet_manager.cc:1939] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1fad92cafead4c48ac222b29a79a266e: Deleting consensus metadata
I20260811 05:03:26.959842 25277 raft_consensus.cc:2258] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:26.960603 25277 ts_tablet_manager.cc:1905] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:26.961084 24601 catalog_manager.cc:4841] TS 1fad92cafead4c48ac222b29a79a266e (127.22.49.194:38129): tablet 7aa1a5d22d7644e0a5d4e7c00e1044bb (table test-table [id=8529a9b5259d404da9a3ce6b8773eacf]) successfully deleted
I20260811 05:03:26.963179 25275 ts_tablet_manager.cc:1918] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 05:03:26.963291 25275 log.cc:1196] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/wal/wals/7aa1a5d22d7644e0a5d4e7c00e1044bb
I20260811 05:03:26.963582 25275 ts_tablet_manager.cc:1939] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P 1c2ac2a0e9fb4eec98b1410f576345ca: Deleting consensus metadata
I20260811 05:03:26.964283 25277 ts_tablet_manager.cc:1918] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 05:03:26.964387 25277 log.cc:1196] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/7aa1a5d22d7644e0a5d4e7c00e1044bb
I20260811 05:03:26.964715 25277 ts_tablet_manager.cc:1939] T 7aa1a5d22d7644e0a5d4e7c00e1044bb P eb7f38305e0a4f799bc4512ec4d83ea6: Deleting consensus metadata
I20260811 05:03:26.965250 24602 catalog_manager.cc:4841] TS 1c2ac2a0e9fb4eec98b1410f576345ca (127.22.49.193:39553): tablet 7aa1a5d22d7644e0a5d4e7c00e1044bb (table test-table [id=8529a9b5259d404da9a3ce6b8773eacf]) successfully deleted
I20260811 05:03:26.965528 24600 catalog_manager.cc:4841] TS eb7f38305e0a4f799bc4512ec4d83ea6 (127.22.49.195:35751): tablet 7aa1a5d22d7644e0a5d4e7c00e1044bb (table test-table [id=8529a9b5259d404da9a3ce6b8773eacf]) successfully deleted
Aug 11 05:03:26 dist-test-slave-w206 krb5kdc[24570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424606, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 05:03:26 dist-test-slave-w206 krb5kdc[24570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424606, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:26.991469 25285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:26.980381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44632 (local address 127.22.49.254:42089)
0811 05:03:26.980740 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:26.980749 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:26.980767 (+ 18us) server_negotiation.cc:407] Connection header received
0811 05:03:26.980958 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:26.980961 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:26.981010 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:26.981114 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:26.981960 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:26.982524 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:26.983508 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:26.983755 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:26.983879 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:26.987278 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:26.987284 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:26.987286 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:26.987331 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:26.989215 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:26.989783 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:26.989786 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:26.989788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:26.989884 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:26.990212 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:26.990215 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:26.990216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:26.990506 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:26.990662 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:26.990942 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 05:03:26.991175 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":116,"threads_started":1}
I20260811 05:03:26.995338 24619 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44632:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:03:26.995920 24619 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:27.002030 24928 tablet_service.cc:1467] Processing CreateTablet for tablet e061c241658640db8c169bfce3d065fe (DEFAULT_TABLE table=test-table [id=0070712b147c4bfaa93e2548decaea82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:27.002048 24775 tablet_service.cc:1467] Processing CreateTablet for tablet e061c241658640db8c169bfce3d065fe (DEFAULT_TABLE table=test-table [id=0070712b147c4bfaa93e2548decaea82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:27.002230 25081 tablet_service.cc:1467] Processing CreateTablet for tablet e061c241658640db8c169bfce3d065fe (DEFAULT_TABLE table=test-table [id=0070712b147c4bfaa93e2548decaea82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:27.002430 24775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e061c241658640db8c169bfce3d065fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:27.002420 24928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e061c241658640db8c169bfce3d065fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:27.002516 25081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e061c241658640db8c169bfce3d065fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:27.006033 25288 tablet_bootstrap.cc:492] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca: Bootstrap starting.
I20260811 05:03:27.006405 25291 tablet_bootstrap.cc:492] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6: Bootstrap starting.
I20260811 05:03:27.006623 25290 tablet_bootstrap.cc:492] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e: Bootstrap starting.
I20260811 05:03:27.007323 25288 tablet_bootstrap.cc:654] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:27.007601 25290 tablet_bootstrap.cc:654] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:27.007593 25291 tablet_bootstrap.cc:654] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:27.009266 25288 tablet_bootstrap.cc:492] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca: No bootstrap required, opened a new log
I20260811 05:03:27.009423 25288 ts_tablet_manager.cc:1397] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:27.009492 25291 tablet_bootstrap.cc:492] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6: No bootstrap required, opened a new log
I20260811 05:03:27.009519 25290 tablet_bootstrap.cc:492] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e: No bootstrap required, opened a new log
I20260811 05:03:27.009624 25291 ts_tablet_manager.cc:1397] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 05:03:27.009624 25290 ts_tablet_manager.cc:1397] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:27.009946 25288 raft_consensus.cc:348] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.010092 25288 raft_consensus.cc:374] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:27.010066 25290 raft_consensus.cc:348] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.010066 25291 raft_consensus.cc:348] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.010141 25288 raft_consensus.cc:729] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c2ac2a0e9fb4eec98b1410f576345ca, State: Initialized, Role: FOLLOWER
I20260811 05:03:27.010185 25290 raft_consensus.cc:374] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:27.010185 25291 raft_consensus.cc:374] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:27.010231 25291 raft_consensus.cc:729] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7f38305e0a4f799bc4512ec4d83ea6, State: Initialized, Role: FOLLOWER
I20260811 05:03:27.010231 25290 raft_consensus.cc:729] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fad92cafead4c48ac222b29a79a266e, State: Initialized, Role: FOLLOWER
I20260811 05:03:27.010313 25288 consensus_queue.cc:260] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.010375 25291 consensus_queue.cc:260] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.010375 25290 consensus_queue.cc:260] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.010668 25290 ts_tablet_manager.cc:1428] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 05:03:27.010668 25291 ts_tablet_manager.cc:1428] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 05:03:27.011493 25288 ts_tablet_manager.cc:1428] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 05:03:27.139931 25295 raft_consensus.cc:482] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:27.140182 25295 raft_consensus.cc:504] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.141062 25295 leader_election.cc:288] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fad92cafead4c48ac222b29a79a266e (127.22.49.194:38129), eb7f38305e0a4f799bc4512ec4d83ea6 (127.22.49.195:35751)
I20260811 05:03:27.141729 24949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e061c241658640db8c169bfce3d065fe" candidate_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fad92cafead4c48ac222b29a79a266e" is_pre_election: true
I20260811 05:03:27.141944 24949 raft_consensus.cc:2454] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c2ac2a0e9fb4eec98b1410f576345ca in term 0.
I20260811 05:03:27.141968 25090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e061c241658640db8c169bfce3d065fe" candidate_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" is_pre_election: true
I20260811 05:03:27.142418 25090 raft_consensus.cc:2454] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c2ac2a0e9fb4eec98b1410f576345ca in term 0.
I20260811 05:03:27.142503 24718 leader_election.cc:302] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c2ac2a0e9fb4eec98b1410f576345ca, 1fad92cafead4c48ac222b29a79a266e; no voters:
I20260811 05:03:27.142763 25295 raft_consensus.cc:2781] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:27.142957 25295 raft_consensus.cc:482] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:27.143070 25295 raft_consensus.cc:3037] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:27.144673 25295 raft_consensus.cc:504] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.145270 25295 leader_election.cc:288] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [CANDIDATE]: Term 1 election: Requested vote from peers 1fad92cafead4c48ac222b29a79a266e (127.22.49.194:38129), eb7f38305e0a4f799bc4512ec4d83ea6 (127.22.49.195:35751)
I20260811 05:03:27.145840 25090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e061c241658640db8c169bfce3d065fe" candidate_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6"
I20260811 05:03:27.145840 24949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e061c241658640db8c169bfce3d065fe" candidate_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fad92cafead4c48ac222b29a79a266e"
I20260811 05:03:27.146009 25090 raft_consensus.cc:3037] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:27.146009 24949 raft_consensus.cc:3037] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:27.147468 24949 raft_consensus.cc:2454] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c2ac2a0e9fb4eec98b1410f576345ca in term 1.
I20260811 05:03:27.147468 25090 raft_consensus.cc:2454] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c2ac2a0e9fb4eec98b1410f576345ca in term 1.
I20260811 05:03:27.147953 24716 leader_election.cc:302] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c2ac2a0e9fb4eec98b1410f576345ca, eb7f38305e0a4f799bc4512ec4d83ea6; no voters:
I20260811 05:03:27.148350 25295 raft_consensus.cc:2781] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:27.148684 25295 raft_consensus.cc:686] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 LEADER]: Becoming Leader. State: Replica: 1c2ac2a0e9fb4eec98b1410f576345ca, State: Running, Role: LEADER
I20260811 05:03:27.148880 25295 consensus_queue.cc:237] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.151355 24619 catalog_manager.cc:5495] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c2ac2a0e9fb4eec98b1410f576345ca (127.22.49.193). New cstate: current_term: 1 leader_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } health_report { overall_health: UNKNOWN } } }
I20260811 05:03:27.195899 25302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:27.190457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32868 (local address 127.22.49.193:39553)
0811 05:03:27.191081 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:27.191092 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:27.191108 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:03:27.191160 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:27.191162 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:27.191221 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:27.191310 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:27.192061 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:27.193030 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:27.194340 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:27.194749 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:27.194902 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:27.195262 (+ 360us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:27.195410 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:27.195482 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:27.195607 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 05:03:27.195670 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":244,"threads_started":1}
I20260811 05:03:27.204360 25096 raft_consensus.cc:1261] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Refusing update from remote peer 1c2ac2a0e9fb4eec98b1410f576345ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:27.204356 24949 raft_consensus.cc:1261] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Refusing update from remote peer 1c2ac2a0e9fb4eec98b1410f576345ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:27.204789 25295 consensus_queue.cc:1035] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:27.205029 25297 consensus_queue.cc:1035] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:27.248157 24618 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:27.248340 24618 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:27.250875 24618 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394: Sending DeleteTablet for 3 replicas of tablet e061c241658640db8c169bfce3d065fe
I20260811 05:03:27.251793 24775 tablet_service.cc:1514] Processing DeleteTablet for tablet e061c241658640db8c169bfce3d065fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:27 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:54656
I20260811 05:03:27.251793 24928 tablet_service.cc:1514] Processing DeleteTablet for tablet e061c241658640db8c169bfce3d065fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:27 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:32870
I20260811 05:03:27.251827 25081 tablet_service.cc:1514] Processing DeleteTablet for tablet e061c241658640db8c169bfce3d065fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:27 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:39086
I20260811 05:03:27.252072 25276 tablet_replica.cc:330] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e: stopping tablet replica
I20260811 05:03:27.252164 25275 tablet_replica.cc:330] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca: stopping tablet replica
I20260811 05:03:27.252164 25277 tablet_replica.cc:330] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6: stopping tablet replica
I20260811 05:03:27.252215 25276 raft_consensus.cc:2229] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:27.252305 25275 raft_consensus.cc:2229] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:03:27.252360 25276 raft_consensus.cc:2258] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:27.252298 25277 raft_consensus.cc:2229] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:27.252485 25277 raft_consensus.cc:2258] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:27.252512 25275 raft_consensus.cc:2258] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:27.252902 24618 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44632:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:03:27.253413 24618 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:27.253486 25275 ts_tablet_manager.cc:1905] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:27.253468 25276 ts_tablet_manager.cc:1905] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:27.255546 25277 ts_tablet_manager.cc:1905] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:27.256107 25275 ts_tablet_manager.cc:1918] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:03:27.256197 25275 log.cc:1196] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-0/wal/wals/e061c241658640db8c169bfce3d065fe
I20260811 05:03:27.256258 25276 ts_tablet_manager.cc:1918] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:03:27.256330 25276 log.cc:1196] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/e061c241658640db8c169bfce3d065fe
I20260811 05:03:27.256511 25275 ts_tablet_manager.cc:1939] T e061c241658640db8c169bfce3d065fe P 1c2ac2a0e9fb4eec98b1410f576345ca: Deleting consensus metadata
I20260811 05:03:27.257444 25276 ts_tablet_manager.cc:1939] T e061c241658640db8c169bfce3d065fe P 1fad92cafead4c48ac222b29a79a266e: Deleting consensus metadata
I20260811 05:03:27.257787 24602 catalog_manager.cc:4841] TS 1c2ac2a0e9fb4eec98b1410f576345ca (127.22.49.193:39553): tablet e061c241658640db8c169bfce3d065fe (table test-table [id=0070712b147c4bfaa93e2548decaea82]) successfully deleted
I20260811 05:03:27.258222 24601 catalog_manager.cc:4841] TS 1fad92cafead4c48ac222b29a79a266e (127.22.49.194:38129): tablet e061c241658640db8c169bfce3d065fe (table test-table [id=0070712b147c4bfaa93e2548decaea82]) successfully deleted
I20260811 05:03:27.258960 25277 ts_tablet_manager.cc:1918] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:03:27.259127 25277 log.cc:1196] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/e061c241658640db8c169bfce3d065fe
I20260811 05:03:27.259433 25277 ts_tablet_manager.cc:1939] T e061c241658640db8c169bfce3d065fe P eb7f38305e0a4f799bc4512ec4d83ea6: Deleting consensus metadata
I20260811 05:03:27.260274 24600 catalog_manager.cc:4841] TS eb7f38305e0a4f799bc4512ec4d83ea6 (127.22.49.195:35751): tablet e061c241658640db8c169bfce3d065fe (table test-table [id=0070712b147c4bfaa93e2548decaea82]) successfully deleted
I20260811 05:03:27.261945 25081 tablet_service.cc:1467] Processing CreateTablet for tablet df58d830778348f8ab86dd090d110a60 (DEFAULT_TABLE table=test-table [id=b4787fe270f8471685ebf2c916dfe10b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:27.262133 24928 tablet_service.cc:1467] Processing CreateTablet for tablet df58d830778348f8ab86dd090d110a60 (DEFAULT_TABLE table=test-table [id=b4787fe270f8471685ebf2c916dfe10b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:27.262161 24775 tablet_service.cc:1467] Processing CreateTablet for tablet df58d830778348f8ab86dd090d110a60 (DEFAULT_TABLE table=test-table [id=b4787fe270f8471685ebf2c916dfe10b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:27.262320 25081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df58d830778348f8ab86dd090d110a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:27.262445 24928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df58d830778348f8ab86dd090d110a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:27.262511 24775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df58d830778348f8ab86dd090d110a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:27.264787 25288 tablet_bootstrap.cc:492] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca: Bootstrap starting.
I20260811 05:03:27.265103 25290 tablet_bootstrap.cc:492] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e: Bootstrap starting.
I20260811 05:03:27.265259 25291 tablet_bootstrap.cc:492] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6: Bootstrap starting.
I20260811 05:03:27.265884 25288 tablet_bootstrap.cc:654] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:27.266192 25291 tablet_bootstrap.cc:654] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:27.266192 25290 tablet_bootstrap.cc:654] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:27.267478 25290 tablet_bootstrap.cc:492] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e: No bootstrap required, opened a new log
I20260811 05:03:27.267520 25288 tablet_bootstrap.cc:492] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca: No bootstrap required, opened a new log
I20260811 05:03:27.267606 25290 ts_tablet_manager.cc:1397] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:27.267629 25288 ts_tablet_manager.cc:1397] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:27.267640 25291 tablet_bootstrap.cc:492] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6: No bootstrap required, opened a new log
I20260811 05:03:27.267717 25291 ts_tablet_manager.cc:1397] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 05:03:27.268074 25288 raft_consensus.cc:348] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.268110 25291 raft_consensus.cc:348] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.268112 25290 raft_consensus.cc:348] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.268220 25288 raft_consensus.cc:374] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:27.268219 25291 raft_consensus.cc:374] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:27.268247 25290 raft_consensus.cc:374] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:27.268255 25291 raft_consensus.cc:729] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7f38305e0a4f799bc4512ec4d83ea6, State: Initialized, Role: FOLLOWER
I20260811 05:03:27.268255 25288 raft_consensus.cc:729] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c2ac2a0e9fb4eec98b1410f576345ca, State: Initialized, Role: FOLLOWER
I20260811 05:03:27.268298 25290 raft_consensus.cc:729] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fad92cafead4c48ac222b29a79a266e, State: Initialized, Role: FOLLOWER
I20260811 05:03:27.268397 25291 consensus_queue.cc:260] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.268440 25288 consensus_queue.cc:260] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.268445 25290 consensus_queue.cc:260] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.268689 25291 ts_tablet_manager.cc:1428] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 05:03:27.268733 25290 ts_tablet_manager.cc:1428] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 05:03:27.268913 25288 ts_tablet_manager.cc:1428] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:27.278774 25307 raft_consensus.cc:482] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:27.278930 25307 raft_consensus.cc:504] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.279567 25307 leader_election.cc:288] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fad92cafead4c48ac222b29a79a266e (127.22.49.194:38129), eb7f38305e0a4f799bc4512ec4d83ea6 (127.22.49.195:35751)
I20260811 05:03:27.280133 25096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df58d830778348f8ab86dd090d110a60" candidate_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" is_pre_election: true
I20260811 05:03:27.280124 24949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df58d830778348f8ab86dd090d110a60" candidate_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fad92cafead4c48ac222b29a79a266e" is_pre_election: true
I20260811 05:03:27.280320 25096 raft_consensus.cc:2454] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c2ac2a0e9fb4eec98b1410f576345ca in term 0.
I20260811 05:03:27.280320 24949 raft_consensus.cc:2454] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c2ac2a0e9fb4eec98b1410f576345ca in term 0.
I20260811 05:03:27.280642 24716 leader_election.cc:302] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c2ac2a0e9fb4eec98b1410f576345ca, eb7f38305e0a4f799bc4512ec4d83ea6; no voters:
I20260811 05:03:27.280856 25307 raft_consensus.cc:2781] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:27.280925 25307 raft_consensus.cc:482] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:27.280964 25307 raft_consensus.cc:3037] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:27.282137 25307 raft_consensus.cc:504] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.282528 25307 leader_election.cc:288] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [CANDIDATE]: Term 1 election: Requested vote from peers 1fad92cafead4c48ac222b29a79a266e (127.22.49.194:38129), eb7f38305e0a4f799bc4512ec4d83ea6 (127.22.49.195:35751)
I20260811 05:03:27.282963 24949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df58d830778348f8ab86dd090d110a60" candidate_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fad92cafead4c48ac222b29a79a266e"
I20260811 05:03:27.283187 24949 raft_consensus.cc:3037] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:27.283140 25096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df58d830778348f8ab86dd090d110a60" candidate_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6"
I20260811 05:03:27.283317 25096 raft_consensus.cc:3037] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:27.284394 24949 raft_consensus.cc:2454] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c2ac2a0e9fb4eec98b1410f576345ca in term 1.
I20260811 05:03:27.284505 25096 raft_consensus.cc:2454] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c2ac2a0e9fb4eec98b1410f576345ca in term 1.
I20260811 05:03:27.284782 24718 leader_election.cc:302] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c2ac2a0e9fb4eec98b1410f576345ca, 1fad92cafead4c48ac222b29a79a266e; no voters:
I20260811 05:03:27.284978 25307 raft_consensus.cc:2781] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:27.285079 25307 raft_consensus.cc:686] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [term 1 LEADER]: Becoming Leader. State: Replica: 1c2ac2a0e9fb4eec98b1410f576345ca, State: Running, Role: LEADER
I20260811 05:03:27.285481 25307 consensus_queue.cc:237] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } }
I20260811 05:03:27.287747 24614 catalog_manager.cc:5495] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c2ac2a0e9fb4eec98b1410f576345ca (127.22.49.193). New cstate: current_term: 1 leader_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c2ac2a0e9fb4eec98b1410f576345ca" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 } health_report { overall_health: UNKNOWN } } }
I20260811 05:03:27.314090 24949 raft_consensus.cc:1261] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Refusing update from remote peer 1c2ac2a0e9fb4eec98b1410f576345ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:27.314539 25096 raft_consensus.cc:1261] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Refusing update from remote peer 1c2ac2a0e9fb4eec98b1410f576345ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:27.314544 25307 consensus_queue.cc:1035] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fad92cafead4c48ac222b29a79a266e" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:27.315091 25306 consensus_queue.cc:1035] T df58d830778348f8ab86dd090d110a60 P 1c2ac2a0e9fb4eec98b1410f576345ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb7f38305e0a4f799bc4512ec4d83ea6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 35751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 05:03:27.332086 25257 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 05:03:28.896858 24619 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:28.897022 24619 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:28.899734 24619 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fde78eab36334127b240cc6bf90c4394: Sending DeleteTablet for 3 replicas of tablet df58d830778348f8ab86dd090d110a60
I20260811 05:03:28.900494 25081 tablet_service.cc:1514] Processing DeleteTablet for tablet df58d830778348f8ab86dd090d110a60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:28 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:39086
I20260811 05:03:28.900538 24928 tablet_service.cc:1514] Processing DeleteTablet for tablet df58d830778348f8ab86dd090d110a60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:28 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:32870
I20260811 05:03:28.900852 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 24700
I20260811 05:03:28.900844 24775 tablet_service.cc:1514] Processing DeleteTablet for tablet df58d830778348f8ab86dd090d110a60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:28 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:54656
I20260811 05:03:28.901502 25339 tablet_replica.cc:330] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e: stopping tablet replica
I20260811 05:03:28.901654 25339 raft_consensus.cc:2229] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:28.901777 25339 raft_consensus.cc:2258] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:28.903927 25338 tablet_replica.cc:330] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6: stopping tablet replica
I20260811 05:03:28.904093 25339 ts_tablet_manager.cc:1905] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:28.904099 25338 raft_consensus.cc:2229] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:28.904232 25338 raft_consensus.cc:2258] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:28.905030 25338 ts_tablet_manager.cc:1905] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:28.907274 25339 ts_tablet_manager.cc:1918] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 05:03:28.907388 25339 log.cc:1196] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/df58d830778348f8ab86dd090d110a60
I20260811 05:03:28.907670 25339 ts_tablet_manager.cc:1939] T df58d830778348f8ab86dd090d110a60 P 1fad92cafead4c48ac222b29a79a266e: Deleting consensus metadata
I20260811 05:03:28.908164 25338 ts_tablet_manager.cc:1918] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 05:03:28.908354 25338 log.cc:1196] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/df58d830778348f8ab86dd090d110a60
I20260811 05:03:28.908694 25338 ts_tablet_manager.cc:1939] T df58d830778348f8ab86dd090d110a60 P eb7f38305e0a4f799bc4512ec4d83ea6: Deleting consensus metadata
I20260811 05:03:28.908766 24601 catalog_manager.cc:4841] TS 1fad92cafead4c48ac222b29a79a266e (127.22.49.194:38129): tablet df58d830778348f8ab86dd090d110a60 (table test-table [id=b4787fe270f8471685ebf2c916dfe10b]) successfully deleted
I20260811 05:03:28.909479 24600 catalog_manager.cc:4841] TS eb7f38305e0a4f799bc4512ec4d83ea6 (127.22.49.195:35751): tablet df58d830778348f8ab86dd090d110a60 (table test-table [id=b4787fe270f8471685ebf2c916dfe10b]) successfully deleted
I20260811 05:03:28.913401 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 24855
W20260811 05:03:28.913345 24602 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:39553 (error 108)
I20260811 05:03:28.915870 25341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:28.915248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:39553 (local address 127.0.0.1:32870)
0811 05:03:28.915644 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:28.915737 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:39553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":94,"threads_started":1}
W20260811 05:03:28.916049 24602 catalog_manager.cc:4584] TS 1c2ac2a0e9fb4eec98b1410f576345ca (127.22.49.193:39553): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet df58d830778348f8ab86dd090d110a60: Network error: Client connection negotiation failed: client connection to 127.22.49.193:39553: connect: Connection refused (error 111)
I20260811 05:03:28.922582 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 25011
I20260811 05:03:28.931118 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 24583
2026-08-11T05:03:28Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (7070 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:03:29 dist-test-slave-w206 krb5kdc[25344](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:03:29 dist-test-slave-w206 krb5kdc[25344](info): set up 2 sockets
Aug 11 05:03:29 dist-test-slave-w206 krb5kdc[25344](info): commencing operation
krb5kdc: starting...
W20260811 05:03:30.061286 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:03:30 dist-test-slave-w206 krb5kdc[25344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:03:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:03:30.208143 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:34373
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:40737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:34373
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:30.333729 25359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:30.334110 25359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:30.334188 25359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:30.338466 25359 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:30.338593 25359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:30.338629 25359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:30.338673 25359 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:30.338709 25359 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:03:30.344467 25359 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:40737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:34373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:34373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:30.345729 25359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:30.346879 25359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:30.355919 25364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:30.355983 25365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:30.356180 25359 server_base.cc:1034] running on GCE node
W20260811 05:03:30.356164 25367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:30.356870 25359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:30.358098 25359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:30.359292 25359 hybrid_clock.cc:648] HybridClock initialized: now 1786424610359259 us; error 51 us; skew 500 ppm
Aug 11 05:03:30 dist-test-slave-w206 krb5kdc[25344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424610, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:30.362215 25359 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:03:30.363300 25359 webserver.cc:460] Webserver started at http://127.22.49.254:36147/ using document root <none> and password file <none>
I20260811 05:03:30.363885 25359 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:30.363986 25359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:30.364229 25359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:30.366537 25359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "e1fb5ba1776743c2a9357125d0c93d58"
format_stamp: "Formatted at 2026-08-11 05:03:30 on dist-test-slave-w206"
server_key: "8ed9f1ec701156daa2bec099497630e8"
server_key_iv: "a4a120a60da659238a5b23bc973a11b9"
server_key_version: "encryptionkey@0"
I20260811 05:03:30.367338 25359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "e1fb5ba1776743c2a9357125d0c93d58"
format_stamp: "Formatted at 2026-08-11 05:03:30 on dist-test-slave-w206"
server_key: "8ed9f1ec701156daa2bec099497630e8"
server_key_iv: "a4a120a60da659238a5b23bc973a11b9"
server_key_version: "encryptionkey@0"
I20260811 05:03:30.371430 25359 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:03:30.373953 25377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:30.375432 25359 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:03:30.375593 25359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "e1fb5ba1776743c2a9357125d0c93d58"
format_stamp: "Formatted at 2026-08-11 05:03:30 on dist-test-slave-w206"
server_key: "8ed9f1ec701156daa2bec099497630e8"
server_key_iv: "a4a120a60da659238a5b23bc973a11b9"
server_key_version: "encryptionkey@0"
I20260811 05:03:30.375722 25359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:30.398025 25359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:30.402024 25359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:30.402309 25359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:30.411127 25359 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:34373
I20260811 05:03:30.411155 25434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:34373 every 8 connection(s)
I20260811 05:03:30.412251 25359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:30.415709 25435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:30.417433 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 25359
I20260811 05:03:30.417599 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:30.417898 22727 external_mini_cluster.cc:1428] Setting key a4f3dbc65a3b7cf08894eab3635c1ac2
I20260811 05:03:30.423274 25435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58: Bootstrap starting.
I20260811 05:03:30.426167 25435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:30.427058 25435 log.cc:824] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58: Log is configured to *not* fsync() on all Append() calls
Aug 11 05:03:30 dist-test-slave-w206 krb5kdc[25344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:30.429730 25435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58: No bootstrap required, opened a new log
I20260811 05:03:30.434414 25438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:30.419473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44582 (local address 127.22.49.254:34373)
0811 05:03:30.419952 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:30.419986 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:30.420031 (+ 45us) server_negotiation.cc:407] Connection header received
0811 05:03:30.420889 (+ 858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:30.420913 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:30.421350 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:30.421732 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:30.422507 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:30.423992 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:30.424879 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:30.425582 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:30.425756 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:30.428613 (+ 2857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:30.428620 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:30.428638 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:30.428673 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:30.430763 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:30.431341 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:30.431347 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:30.431355 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:30.431514 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:30.431831 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:30.431834 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:30.431836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:30.432458 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:30.432704 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:30.432997 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 05:03:30.433335 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":127,"threads_started":1}
I20260811 05:03:30.434824 25435 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1fb5ba1776743c2a9357125d0c93d58" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 34373 } }
I20260811 05:03:30.435149 25435 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:30.435227 25435 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1fb5ba1776743c2a9357125d0c93d58, State: Initialized, Role: FOLLOWER
I20260811 05:03:30.435714 25435 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1fb5ba1776743c2a9357125d0c93d58" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 34373 } }
I20260811 05:03:30.435884 25435 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:30.435961 25435 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:30.436067 25435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:30.437466 25435 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1fb5ba1776743c2a9357125d0c93d58" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 34373 } }
I20260811 05:03:30.437880 25435 leader_election.cc:302] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1fb5ba1776743c2a9357125d0c93d58; no voters:
I20260811 05:03:30.438199 25435 leader_election.cc:288] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:30.438481 25441 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:30.438701 25441 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [term 1 LEADER]: Becoming Leader. State: Replica: e1fb5ba1776743c2a9357125d0c93d58, State: Running, Role: LEADER
I20260811 05:03:30.439114 25441 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1fb5ba1776743c2a9357125d0c93d58" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 34373 } }
I20260811 05:03:30.439716 25435 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:30.441463 25442 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1fb5ba1776743c2a9357125d0c93d58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1fb5ba1776743c2a9357125d0c93d58" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 34373 } } }
I20260811 05:03:30.441643 25442 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:30.442221 25443 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1fb5ba1776743c2a9357125d0c93d58. Latest consensus state: current_term: 1 leader_uuid: "e1fb5ba1776743c2a9357125d0c93d58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1fb5ba1776743c2a9357125d0c93d58" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 34373 } } }
I20260811 05:03:30.442456 25443 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58 [sys.catalog]: This master's current role is: LEADER
W20260811 05:03:30.444839 25457 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:03:30.444931 25457 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:03:30.445019 25455 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:30.445806 25455 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:30.451620 25455 catalog_manager.cc:1347] Generated new cluster ID: 8a3c204578b741c2830f5472824e4d52
I20260811 05:03:30.451717 25455 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:30.460382 25455 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:30.461769 25455 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:30.470292 25455 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1fb5ba1776743c2a9357125d0c93d58: Generated new TSK 0
I20260811 05:03:30.471292 25455 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:03:30.507534 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:34373
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:40737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:30.630108 25463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:30.630446 25463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:30.630494 25463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:30.635049 25463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:30.635128 25463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:30.635195 25463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:03:30.641184 25463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:40737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:34373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:30.642357 25463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:30.643474 25463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:30.654345 25468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:30.654356 25471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:30.654533 25463 server_base.cc:1034] running on GCE node
W20260811 05:03:30.654871 25469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:30.655393 25463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:30.656167 25463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:30.657368 25463 hybrid_clock.cc:648] HybridClock initialized: now 1786424610657354 us; error 32 us; skew 500 ppm
Aug 11 05:03:30 dist-test-slave-w206 krb5kdc[25344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424610, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:30.660737 25463 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:03:30.661706 25463 webserver.cc:460] Webserver started at http://127.22.49.193:35767/ using document root <none> and password file <none>
I20260811 05:03:30.662348 25463 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:30.662459 25463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:30.662709 25463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:30.665056 25463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "9ec586a038e144558b4c5b3cb634040a"
format_stamp: "Formatted at 2026-08-11 05:03:30 on dist-test-slave-w206"
server_key: "357e7f31e9b2a7f3e11b8b8e3a074d40"
server_key_iv: "967c5c6f3b0be236cafca031db8eeae2"
server_key_version: "encryptionkey@0"
I20260811 05:03:30.665719 25463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "9ec586a038e144558b4c5b3cb634040a"
format_stamp: "Formatted at 2026-08-11 05:03:30 on dist-test-slave-w206"
server_key: "357e7f31e9b2a7f3e11b8b8e3a074d40"
server_key_iv: "967c5c6f3b0be236cafca031db8eeae2"
server_key_version: "encryptionkey@0"
I20260811 05:03:30.669968 25463 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:03:30.672854 25479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:30.674173 25463 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:30.674371 25463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "9ec586a038e144558b4c5b3cb634040a"
format_stamp: "Formatted at 2026-08-11 05:03:30 on dist-test-slave-w206"
server_key: "357e7f31e9b2a7f3e11b8b8e3a074d40"
server_key_iv: "967c5c6f3b0be236cafca031db8eeae2"
server_key_version: "encryptionkey@0"
I20260811 05:03:30.674505 25463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:30.694651 25463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:30.698396 25463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:30.698662 25463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:30.699390 25463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:30.700301 25463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:30.700380 25463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:30.700461 25463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:30.700505 25463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:30.709853 25463 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:34839
I20260811 05:03:30.709877 25606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:34839 every 8 connection(s)
I20260811 05:03:30.710804 25463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:03:30.716084 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 25463
I20260811 05:03:30.716178 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:03:30.716447 22727 external_mini_cluster.cc:1428] Setting key 1f54551bc3988dd9cb31a1a4102d676a
Aug 11 05:03:30 dist-test-slave-w206 krb5kdc[25344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424610, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:30.725834 25438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:30.712770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:46545 (local address 127.22.49.254:34373)
0811 05:03:30.712928 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:30.712931 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:30.713788 (+ 857us) server_negotiation.cc:407] Connection header received
0811 05:03:30.715182 (+ 1394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:30.715186 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:30.715246 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:30.715357 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:30.716641 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:30.717305 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:30.718596 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:30.718844 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:30.718968 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:30.721916 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:30.721920 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:30.721922 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:30.721949 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:30.723632 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:30.724224 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:30.724227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:30.724229 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:30.724314 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:30.724675 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:30.724680 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:30.724681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:30.724880 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:30.724990 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:30.725526 (+ 536us) server_negotiation.cc:299] Negotiation successful
0811 05:03:30.725663 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:03:30.726754 25609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:30.713135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:34373 (local address 127.22.49.193:46545)
0811 05:03:30.713607 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:30.713677 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:30.714948 (+ 1271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:30.715536 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:30.715543 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:30.715912 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:30.716456 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:30.716470 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:30.717440 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:30.717444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:30.718463 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:30.718473 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:30.719038 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:30.719043 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:30.719213 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:30.719888 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:30.719917 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:30.721717 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:30.723786 (+ 2069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:30.723793 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:30.723825 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:30.724113 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:30.724411 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:30.724414 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:30.724416 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:30.724575 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:30.725004 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:30.725012 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:30.725280 (+ 268us) client_negotiation.cc:769] Sending connection context
0811 05:03:30.725485 (+ 205us) client_negotiation.cc:240] Negotiation successful
0811 05:03:30.725840 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":131,"threads_started":1}
I20260811 05:03:30.728132 25607 heartbeater.cc:347] Connected to a master server at 127.22.49.254:34373
I20260811 05:03:30.728397 25607 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:30.728935 25607 heartbeater.cc:511] Master 127.22.49.254:34373 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
I20260811 05:03:30.730674 25395 ts_manager.cc:194] Registered new tserver with Master: 9ec586a038e144558b4c5b3cb634040a (127.22.49.193:34839)
I20260811 05:03:30.731922 25395 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:46545
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:03:30.752172 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:34373
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:40737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:30.871595 25612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:30.871902 25612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:30.871979 25612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:30.876477 25612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:30.876557 25612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:30.876653 25612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:03:30.882853 25612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:40737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:34373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:30.884158 25612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:30.885288 25612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:30.895895 25623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:30.895877 25619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:30.895877 25621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:30.896433 25612 server_base.cc:1034] running on GCE node
I20260811 05:03:30.896893 25612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:30.897703 25612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:30.898926 25612 hybrid_clock.cc:648] HybridClock initialized: now 1786424610898896 us; error 38 us; skew 500 ppm
Aug 11 05:03:30 dist-test-slave-w206 krb5kdc[25344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424610, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:30.902262 25612 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:03:30.903350 25612 webserver.cc:460] Webserver started at http://127.22.49.194:37671/ using document root <none> and password file <none>
I20260811 05:03:30.903975 25612 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:30.904074 25612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:30.904322 25612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:30.906513 25612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "f5cbb725700247e7818f76943d64cc89"
format_stamp: "Formatted at 2026-08-11 05:03:30 on dist-test-slave-w206"
server_key: "90a645579159969a721052726170c89f"
server_key_iv: "a691671175cfab18b558f3dcefc2da56"
server_key_version: "encryptionkey@0"
I20260811 05:03:30.907186 25612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "f5cbb725700247e7818f76943d64cc89"
format_stamp: "Formatted at 2026-08-11 05:03:30 on dist-test-slave-w206"
server_key: "90a645579159969a721052726170c89f"
server_key_iv: "a691671175cfab18b558f3dcefc2da56"
server_key_version: "encryptionkey@0"
I20260811 05:03:30.911360 25612 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 05:03:30.914026 25631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:30.915573 25612 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:03:30.915692 25612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "f5cbb725700247e7818f76943d64cc89"
format_stamp: "Formatted at 2026-08-11 05:03:30 on dist-test-slave-w206"
server_key: "90a645579159969a721052726170c89f"
server_key_iv: "a691671175cfab18b558f3dcefc2da56"
server_key_version: "encryptionkey@0"
I20260811 05:03:30.915797 25612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:30.927073 25612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:30.930344 25612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:30.930591 25612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:30.931321 25612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:30.932233 25612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:30.932283 25612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:30.932325 25612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:30.932343 25612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:30.942723 25612 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:37401
I20260811 05:03:30.942742 25754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:37401 every 8 connection(s)
I20260811 05:03:30.943789 25612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:03:30.950966 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 25612
I20260811 05:03:30.951182 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:03:30.951519 22727 external_mini_cluster.cc:1428] Setting key ba8c6f7dbb73bcb0583a78584b5ae2b5
Aug 11 05:03:30 dist-test-slave-w206 krb5kdc[25344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424610, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:30.959710 25438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:30.945695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:50711 (local address 127.22.49.254:34373)
0811 05:03:30.945872 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:30.945877 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:30.946744 (+ 867us) server_negotiation.cc:407] Connection header received
0811 05:03:30.948162 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:30.948165 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:30.948220 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:30.948303 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:30.949736 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:30.950288 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:30.951723 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:30.952028 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:30.952152 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:30.955076 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:30.955079 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:30.955081 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:30.955107 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:30.956988 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:30.957592 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:30.957599 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:30.957603 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:30.957705 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:30.958069 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:30.958075 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:30.958080 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:30.958380 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:30.958521 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:30.959297 (+ 776us) server_negotiation.cc:299] Negotiation successful
0811 05:03:30.959458 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 05:03:30.960554 25757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:30.946089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:34373 (local address 127.22.49.194:50711)
0811 05:03:30.946579 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:30.946625 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:30.947927 (+ 1302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:30.948502 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:30.948510 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:30.948901 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:30.949563 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:30.949579 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:30.950470 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:30.950472 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:30.951553 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:30.951563 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:30.952217 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:30.952221 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:30.952438 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:30.953118 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:30.953135 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:30.954860 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:30.957137 (+ 2277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:30.957142 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:30.957158 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:30.957470 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:30.957799 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:30.957801 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:30.957802 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:30.957963 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:30.958566 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:30.958573 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:30.958935 (+ 362us) client_negotiation.cc:769] Sending connection context
0811 05:03:30.959190 (+ 255us) client_negotiation.cc:240] Negotiation successful
0811 05:03:30.959514 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":131,"threads_started":1}
I20260811 05:03:30.961969 25755 heartbeater.cc:347] Connected to a master server at 127.22.49.254:34373
I20260811 05:03:30.962257 25755 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:30.963013 25755 heartbeater.cc:511] Master 127.22.49.254:34373 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
I20260811 05:03:30.964314 25395 ts_manager.cc:194] Registered new tserver with Master: f5cbb725700247e7818f76943d64cc89 (127.22.49.194:37401)
I20260811 05:03:30.965052 25395 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:50711
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:03:30.986862 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:34373
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:40737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:31.108979 25761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:31.109328 25761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:31.109417 25761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:31.113768 25761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:31.113883 25761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:31.113981 25761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:03:31.120102 25761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:40737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:34373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:31.121359 25761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:31.122424 25761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:31.132941 25771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:31.132962 25769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:31.132954 25768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:31.133155 25761 server_base.cc:1034] running on GCE node
I20260811 05:03:31.133756 25761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:31.134541 25761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:31.135742 25761 hybrid_clock.cc:648] HybridClock initialized: now 1786424611135729 us; error 31 us; skew 500 ppm
Aug 11 05:03:31 dist-test-slave-w206 krb5kdc[25344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424611, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:31.138906 25761 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:03:31.140077 25761 webserver.cc:460] Webserver started at http://127.22.49.195:39725/ using document root <none> and password file <none>
I20260811 05:03:31.140749 25761 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:31.140821 25761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:31.141005 25761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:31.143373 25761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "376ee64f70944158ad45f3c89719bee1"
format_stamp: "Formatted at 2026-08-11 05:03:31 on dist-test-slave-w206"
server_key: "3b058c1059a72ed66318b34899acbf74"
server_key_iv: "49327c088b87045416cc03125b21e7d7"
server_key_version: "encryptionkey@0"
I20260811 05:03:31.143949 25761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "376ee64f70944158ad45f3c89719bee1"
format_stamp: "Formatted at 2026-08-11 05:03:31 on dist-test-slave-w206"
server_key: "3b058c1059a72ed66318b34899acbf74"
server_key_iv: "49327c088b87045416cc03125b21e7d7"
server_key_version: "encryptionkey@0"
I20260811 05:03:31.148299 25761 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 05:03:31.151265 25778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:31.152763 25761 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 05:03:31.152899 25761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "376ee64f70944158ad45f3c89719bee1"
format_stamp: "Formatted at 2026-08-11 05:03:31 on dist-test-slave-w206"
server_key: "3b058c1059a72ed66318b34899acbf74"
server_key_iv: "49327c088b87045416cc03125b21e7d7"
server_key_version: "encryptionkey@0"
I20260811 05:03:31.153096 25761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:31.176872 25761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:31.182775 25761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:31.183044 25761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:31.183705 25761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:31.184561 25761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:31.184612 25761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:31.184659 25761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:31.184682 25761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:31.194298 25761 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:46045
I20260811 05:03:31.194320 25903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:46045 every 8 connection(s)
I20260811 05:03:31.195513 25761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:03:31.205540 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 25761
I20260811 05:03:31.205669 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
Aug 11 05:03:31 dist-test-slave-w206 krb5kdc[25344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424611, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:31.205998 22727 external_mini_cluster.cc:1428] Setting key 112fa63a738d04fc49329962b386955e
I20260811 05:03:31.210942 25438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:31.197746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:40457 (local address 127.22.49.254:34373)
0811 05:03:31.197908 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:31.197913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:31.198880 (+ 967us) server_negotiation.cc:407] Connection header received
0811 05:03:31.200242 (+ 1362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:31.200246 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:31.200306 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:31.200387 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:31.201618 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:31.202210 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:31.203456 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:31.203671 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:31.203756 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:31.206731 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:31.206739 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:31.206741 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:31.206772 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:31.208662 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:31.209246 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:31.209251 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:31.209252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:31.209349 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:31.209731 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:31.209736 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:31.209738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:31.209948 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:31.210066 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:31.210626 (+ 560us) server_negotiation.cc:299] Negotiation successful
0811 05:03:31.210770 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 05:03:31.211895 25906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:31.198186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:34373 (local address 127.22.49.195:40457)
0811 05:03:31.198694 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:31.198739 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:31.200012 (+ 1273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:31.200561 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:31.200568 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:31.200973 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:31.201465 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:31.201480 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:31.202388 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:31.202392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:31.203335 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:31.203344 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:31.203826 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:31.203829 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:31.203982 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:31.204679 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:31.204696 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:31.206536 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:31.208804 (+ 2268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:31.208811 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:31.208830 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:31.209134 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:31.209448 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:31.209452 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:31.209454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:31.209626 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:31.210070 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:31.210080 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:31.210367 (+ 287us) client_negotiation.cc:769] Sending connection context
0811 05:03:31.210584 (+ 217us) client_negotiation.cc:240] Negotiation successful
0811 05:03:31.211035 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":129,"threads_started":1}
I20260811 05:03:31.213171 25904 heartbeater.cc:347] Connected to a master server at 127.22.49.254:34373
I20260811 05:03:31.213490 25904 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:31.214057 25904 heartbeater.cc:511] Master 127.22.49.254:34373 requested a full tablet report, sending...
I20260811 05:03:31.215273 25395 ts_manager.cc:194] Registered new tserver with Master: 376ee64f70944158ad45f3c89719bee1 (127.22.49.195:46045)
I20260811 05:03:31.215905 25395 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:40457
I20260811 05:03:31.220840 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 05:03:31.238161 25438 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:03:31.236494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44596 (local address 127.22.49.254:34373)
0811 05:03:31.236657 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:31.236662 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:31.236847 (+ 185us) server_negotiation.cc:407] Connection header received
0811 05:03:31.236969 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:31.236972 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:31.237021 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:31.237094 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:31.238004 (+ 910us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44596: BlockingRecv error: recv got EOF from 127.0.0.1:44596 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 05:03:31.239367 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 25463
I20260811 05:03:31.247828 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 25612
I20260811 05:03:31.255604 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 25761
I20260811 05:03:31.263365 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 25359
2026-08-11T05:03:31Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2330 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:03:31 dist-test-slave-w206 krb5kdc[25917](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:03:31 dist-test-slave-w206 krb5kdc[25917](info): set up 2 sockets
Aug 11 05:03:31 dist-test-slave-w206 krb5kdc[25917](info): commencing operation
krb5kdc: starting...
W20260811 05:03:32.409562 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:03:32 dist-test-slave-w206 krb5kdc[25917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424612, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:03:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:03:32.568199 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:40111
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:40111
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:32.699368 25934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:32.699771 25934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:32.699856 25934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:32.704506 25934 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:32.704633 25934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:32.704670 25934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:32.704710 25934 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:32.704768 25934 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:03:32.711081 25934 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:40111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:40111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:32.712471 25934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:32.713725 25934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:32.725008 25943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:32.725188 25941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:32.725343 25940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:32.725188 25934 server_base.cc:1034] running on GCE node
I20260811 05:03:32.726068 25934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:32.727586 25934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:32.728907 25934 hybrid_clock.cc:648] HybridClock initialized: now 1786424612728829 us; error 100 us; skew 500 ppm
Aug 11 05:03:32 dist-test-slave-w206 krb5kdc[25917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424612, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:32.733001 25934 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:03:32.734331 25934 webserver.cc:460] Webserver started at http://127.22.49.254:37311/ using document root <none> and password file <none>
I20260811 05:03:32.735191 25934 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:32.735314 25934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:32.735599 25934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:32.738170 25934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "5a9bacc8311d4011b03d3b27837e10f5"
format_stamp: "Formatted at 2026-08-11 05:03:32 on dist-test-slave-w206"
server_key: "caf461b6fe0c512e1729eef2c3f75630"
server_key_iv: "e74c0d3e2b3cc3394694118616ec6825"
server_key_version: "encryptionkey@0"
I20260811 05:03:32.738937 25934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "5a9bacc8311d4011b03d3b27837e10f5"
format_stamp: "Formatted at 2026-08-11 05:03:32 on dist-test-slave-w206"
server_key: "caf461b6fe0c512e1729eef2c3f75630"
server_key_iv: "e74c0d3e2b3cc3394694118616ec6825"
server_key_version: "encryptionkey@0"
I20260811 05:03:32.743999 25934 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 05:03:32.747536 25951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:32.749270 25934 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:03:32.749485 25934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "5a9bacc8311d4011b03d3b27837e10f5"
format_stamp: "Formatted at 2026-08-11 05:03:32 on dist-test-slave-w206"
server_key: "caf461b6fe0c512e1729eef2c3f75630"
server_key_iv: "e74c0d3e2b3cc3394694118616ec6825"
server_key_version: "encryptionkey@0"
I20260811 05:03:32.749652 25934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:32.777734 25934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:32.782475 25934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:32.782757 25934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:32.793677 25934 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:40111
I20260811 05:03:32.793741 26011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:40111 every 8 connection(s)
I20260811 05:03:32.795104 25934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:32.798108 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 25934
I20260811 05:03:32.798269 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:32.798606 22727 external_mini_cluster.cc:1428] Setting key e0de4b9cd4267b043d03c4d8e9dd7c1a
I20260811 05:03:32.800004 26013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:32.808193 26013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5: Bootstrap starting.
Aug 11 05:03:32 dist-test-slave-w206 krb5kdc[25917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424612, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:32.811828 26013 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:32.813331 26013 log.cc:824] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:32.817340 26013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5: No bootstrap required, opened a new log
I20260811 05:03:32.821769 26016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:32.800470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39094 (local address 127.22.49.254:40111)
0811 05:03:32.801043 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:32.801078 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:32.801124 (+ 46us) server_negotiation.cc:407] Connection header received
0811 05:03:32.801900 (+ 776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:32.801924 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:32.802381 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:32.802760 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:32.804015 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:32.805250 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:32.806628 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:32.807375 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:32.807538 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:32.812462 (+ 4924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:32.812470 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:32.812493 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:32.812543 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:32.816377 (+ 3834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:32.817201 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:32.817209 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:32.817216 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:32.817437 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:32.817841 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:32.817845 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:32.817847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:32.819188 (+ 1341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:32.819484 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:32.820006 (+ 522us) server_negotiation.cc:299] Negotiation successful
0811 05:03:32.820422 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":200,"threads_started":1}
I20260811 05:03:32.823630 26013 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a9bacc8311d4011b03d3b27837e10f5" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40111 } }
I20260811 05:03:32.823942 26013 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:32.823984 26013 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a9bacc8311d4011b03d3b27837e10f5, State: Initialized, Role: FOLLOWER
I20260811 05:03:32.824621 26013 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a9bacc8311d4011b03d3b27837e10f5" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40111 } }
I20260811 05:03:32.824810 26013 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:32.824929 26013 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:32.825057 26013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:32.825947 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:03:32.826471 26013 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a9bacc8311d4011b03d3b27837e10f5" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40111 } }
I20260811 05:03:32.826905 26013 leader_election.cc:302] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a9bacc8311d4011b03d3b27837e10f5; no voters:
I20260811 05:03:32.827368 26013 leader_election.cc:288] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:32.827466 26018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:32.827714 26018 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [term 1 LEADER]: Becoming Leader. State: Replica: 5a9bacc8311d4011b03d3b27837e10f5, State: Running, Role: LEADER
I20260811 05:03:32.828145 26018 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a9bacc8311d4011b03d3b27837e10f5" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40111 } }
I20260811 05:03:32.829007 26013 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:32.830365 26019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a9bacc8311d4011b03d3b27837e10f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a9bacc8311d4011b03d3b27837e10f5" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40111 } } }
I20260811 05:03:32.830521 26019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:32.830428 26020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a9bacc8311d4011b03d3b27837e10f5. Latest consensus state: current_term: 1 leader_uuid: "5a9bacc8311d4011b03d3b27837e10f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a9bacc8311d4011b03d3b27837e10f5" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40111 } } }
I20260811 05:03:32.830610 26020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:32.831211 26028 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:32.835335 26028 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:32.843295 26028 catalog_manager.cc:1347] Generated new cluster ID: 5547a9f8368a4f66aba70330c4f8b184
I20260811 05:03:32.843401 26028 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:32.855850 26016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:32.847823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39100 (local address 127.22.49.254:40111)
0811 05:03:32.847960 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:32.847964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:32.848300 (+ 336us) server_negotiation.cc:407] Connection header received
0811 05:03:32.848446 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:32.848450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:32.848523 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:32.848643 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:32.849380 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:32.850355 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:32.852551 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:32.853032 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:32.853180 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:32.854568 (+ 1388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:32.854575 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:32.854578 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:32.855270 (+ 692us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:32.855311 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:32.855332 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:32.855446 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:32.855582 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 05:03:32.855668 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":48}
I20260811 05:03:32.855857 26028 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:32.857484 26028 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:32.873739 26028 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a9bacc8311d4011b03d3b27837e10f5: Generated new TSK 0
I20260811 05:03:32.874882 26028 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:03:32.890069 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 25934
2026-08-11T05:03:32Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1624 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:03:32 dist-test-slave-w206 krb5kdc[26050](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:03:32 dist-test-slave-w206 krb5kdc[26050](info): set up 2 sockets
Aug 11 05:03:32 dist-test-slave-w206 krb5kdc[26050](info): commencing operation
krb5kdc: starting...
W20260811 05:03:34.022336 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:03:34 dist-test-slave-w206 krb5kdc[26050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424614, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:03:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:03:34.188733 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:45695
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:45695
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:34.321883 26063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:34.322238 26063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:34.322284 26063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:34.326754 26063 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:34.326902 26063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:34.326941 26063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:34.326979 26063 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:34.327070 26063 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:03:34.333107 26063 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:45695
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:45695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:34.334414 26063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:34.335580 26063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:34.345646 26069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:34.345650 26068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:34.345650 26071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:34.346015 26063 server_base.cc:1034] running on GCE node
I20260811 05:03:34.346724 26063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:34.348086 26063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:34.349280 26063 hybrid_clock.cc:648] HybridClock initialized: now 1786424614349254 us; error 57 us; skew 500 ppm
Aug 11 05:03:34 dist-test-slave-w206 krb5kdc[26050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424614, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:34.356823 26063 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:03:34.358022 26063 webserver.cc:460] Webserver started at http://127.22.49.254:43601/ using document root <none> and password file <none>
I20260811 05:03:34.358728 26063 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:34.358843 26063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:34.359182 26063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:34.361568 26063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "ce9e5c00de5f47d09bb17f23ca49482b"
format_stamp: "Formatted at 2026-08-11 05:03:34 on dist-test-slave-w206"
server_key: "cd7efc84859a738b6ff889909dce62b8"
server_key_iv: "a7302e793c8c7768010a0eefe447f26c"
server_key_version: "encryptionkey@0"
I20260811 05:03:34.362251 26063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "ce9e5c00de5f47d09bb17f23ca49482b"
format_stamp: "Formatted at 2026-08-11 05:03:34 on dist-test-slave-w206"
server_key: "cd7efc84859a738b6ff889909dce62b8"
server_key_iv: "a7302e793c8c7768010a0eefe447f26c"
server_key_version: "encryptionkey@0"
I20260811 05:03:34.366842 26063 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260811 05:03:34.369966 26079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:34.371805 26063 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:03:34.372010 26063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "ce9e5c00de5f47d09bb17f23ca49482b"
format_stamp: "Formatted at 2026-08-11 05:03:34 on dist-test-slave-w206"
server_key: "cd7efc84859a738b6ff889909dce62b8"
server_key_iv: "a7302e793c8c7768010a0eefe447f26c"
server_key_version: "encryptionkey@0"
I20260811 05:03:34.372175 26063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:34.390533 26063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:34.394399 26063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:34.394666 26063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:34.403321 26063 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:45695
I20260811 05:03:34.403795 26137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:45695 every 8 connection(s)
I20260811 05:03:34.404546 26063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:34.407758 26138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:34.408635 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 26063
I20260811 05:03:34.408764 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:34.409091 22727 external_mini_cluster.cc:1428] Setting key e754d6aeafb059a145d2a3bab7e44892
I20260811 05:03:34.416326 26138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b: Bootstrap starting.
Aug 11 05:03:34 dist-test-slave-w206 krb5kdc[26050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424614, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:34.419714 26138 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:34.420742 26138 log.cc:824] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:34.424417 26138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b: No bootstrap required, opened a new log
I20260811 05:03:34.427042 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:34.410670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44164 (local address 127.22.49.254:45695)
0811 05:03:34.411209 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:34.411227 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:34.411265 (+ 38us) server_negotiation.cc:407] Connection header received
0811 05:03:34.411984 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:34.412005 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:34.412386 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:34.412718 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:34.413822 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:34.414885 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:34.416197 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:34.416809 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:34.416990 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:34.420318 (+ 3328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:34.420326 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:34.420346 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:34.420389 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:34.423197 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:34.424004 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:34.424011 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:34.424018 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:34.424181 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:34.424598 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:34.424604 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:34.424606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:34.425136 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:34.425387 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:34.425758 (+ 371us) server_negotiation.cc:299] Negotiation successful
0811 05:03:34.426124 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":162,"threads_started":1}
I20260811 05:03:34.428804 26138 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce9e5c00de5f47d09bb17f23ca49482b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45695 } }
I20260811 05:03:34.429219 26138 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:34.429275 26138 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce9e5c00de5f47d09bb17f23ca49482b, State: Initialized, Role: FOLLOWER
I20260811 05:03:34.429850 26138 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce9e5c00de5f47d09bb17f23ca49482b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45695 } }
I20260811 05:03:34.430059 26138 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:34.430143 26138 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:34.430238 26138 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:34.431506 26138 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce9e5c00de5f47d09bb17f23ca49482b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45695 } }
I20260811 05:03:34.431931 26138 leader_election.cc:302] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce9e5c00de5f47d09bb17f23ca49482b; no voters:
I20260811 05:03:34.432287 26138 leader_election.cc:288] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:34.432593 26143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:34.432943 26143 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [term 1 LEADER]: Becoming Leader. State: Replica: ce9e5c00de5f47d09bb17f23ca49482b, State: Running, Role: LEADER
I20260811 05:03:34.433326 26143 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce9e5c00de5f47d09bb17f23ca49482b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45695 } }
I20260811 05:03:34.433921 26138 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:34.435295 26145 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce9e5c00de5f47d09bb17f23ca49482b. Latest consensus state: current_term: 1 leader_uuid: "ce9e5c00de5f47d09bb17f23ca49482b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce9e5c00de5f47d09bb17f23ca49482b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45695 } } }
I20260811 05:03:34.435473 26145 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:34.435853 26144 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce9e5c00de5f47d09bb17f23ca49482b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce9e5c00de5f47d09bb17f23ca49482b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45695 } } }
I20260811 05:03:34.435976 26152 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:34.436024 26144 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:34.439642 26152 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:34.448629 26152 catalog_manager.cc:1347] Generated new cluster ID: d5128aff0f2544bda69eab5dda97d440
I20260811 05:03:34.448729 26152 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:34.457633 26152 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:34.458950 26152 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:34.475723 26152 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce9e5c00de5f47d09bb17f23ca49482b: Generated new TSK 0
I20260811 05:03:34.476841 26152 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:03:34.529259 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45695
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:34.676082 26166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:34.676462 26166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:34.676514 26166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:34.681144 26166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:34.681257 26166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:34.681324 26166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:03:34.687726 26166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:34.689123 26166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:34.690315 26166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:34.701769 26172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:34.701779 26173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:34.702333 26175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:34.703085 26166 server_base.cc:1034] running on GCE node
I20260811 05:03:34.703693 26166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:34.704417 26166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:34.705636 26166 hybrid_clock.cc:648] HybridClock initialized: now 1786424614705606 us; error 43 us; skew 500 ppm
Aug 11 05:03:34 dist-test-slave-w206 krb5kdc[26050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424614, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:34.710423 26166 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:03:34.711700 26166 webserver.cc:460] Webserver started at http://127.22.49.193:36355/ using document root <none> and password file <none>
I20260811 05:03:34.712365 26166 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:34.712474 26166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:34.712741 26166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:34.715332 26166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "84faf12cd30a4414802c5c81fce93ebd"
format_stamp: "Formatted at 2026-08-11 05:03:34 on dist-test-slave-w206"
server_key: "8e1553cd45fd09a3f9affb8d2a91e37c"
server_key_iv: "40ad7b87ed71b477a0184abfa8516300"
server_key_version: "encryptionkey@0"
I20260811 05:03:34.716022 26166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "84faf12cd30a4414802c5c81fce93ebd"
format_stamp: "Formatted at 2026-08-11 05:03:34 on dist-test-slave-w206"
server_key: "8e1553cd45fd09a3f9affb8d2a91e37c"
server_key_iv: "40ad7b87ed71b477a0184abfa8516300"
server_key_version: "encryptionkey@0"
I20260811 05:03:34.720523 26166 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:03:34.723692 26182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:34.725451 26166 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:03:34.725672 26166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "84faf12cd30a4414802c5c81fce93ebd"
format_stamp: "Formatted at 2026-08-11 05:03:34 on dist-test-slave-w206"
server_key: "8e1553cd45fd09a3f9affb8d2a91e37c"
server_key_iv: "40ad7b87ed71b477a0184abfa8516300"
server_key_version: "encryptionkey@0"
I20260811 05:03:34.725837 26166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:34.754393 26166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:34.758900 26166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:34.759212 26166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:34.760012 26166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:34.761040 26166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:34.761118 26166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:34.761188 26166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:34.761242 26166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:34.771540 26166 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:34627
I20260811 05:03:34.771607 26314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:34627 every 8 connection(s)
I20260811 05:03:34.772665 26166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:03:34.780637 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 26166
I20260811 05:03:34.780797 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:03:34.781150 22727 external_mini_cluster.cc:1428] Setting key a43f79e76fd72389d385d1a700bbc956
Aug 11 05:03:34 dist-test-slave-w206 krb5kdc[26050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424614, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:34.791656 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:34.775640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:41903 (local address 127.22.49.254:45695)
0811 05:03:34.775914 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:34.775921 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:34.777556 (+ 1635us) server_negotiation.cc:407] Connection header received
0811 05:03:34.779246 (+ 1690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:34.779250 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:34.779312 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:34.779405 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:34.781126 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:34.781812 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:34.783524 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:34.783937 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:34.784072 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:34.787336 (+ 3264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:34.787339 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:34.787341 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:34.787374 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:34.789062 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:34.789778 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:34.789782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:34.789783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:34.789877 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:34.790274 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:34.790278 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:34.790279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:34.790498 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:34.790613 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:34.791316 (+ 703us) server_negotiation.cc:299] Negotiation successful
0811 05:03:34.791471 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260811 05:03:34.792620 26317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:34.776307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:45695 (local address 127.22.49.193:41903)
0811 05:03:34.777279 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:34.777383 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:34.778877 (+ 1494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:34.779621 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:34.779630 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:34.780106 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:34.780886 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:34.780912 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:34.781969 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:34.781998 (+ 29us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:34.783381 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:34.783392 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:34.784120 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:34.784122 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:34.784284 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:34.785082 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:34.785101 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:34.787081 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:34.789253 (+ 2172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:34.789261 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:34.789292 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:34.789643 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:34.789978 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:34.789981 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:34.789983 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:34.790161 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:34.790629 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:34.790638 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:34.790938 (+ 300us) client_negotiation.cc:769] Sending connection context
0811 05:03:34.791218 (+ 280us) client_negotiation.cc:240] Negotiation successful
0811 05:03:34.791634 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"thread_start_us":440,"threads_started":1}
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:03:34.794210 26315 heartbeater.cc:347] Connected to a master server at 127.22.49.254:45695
I20260811 05:03:34.794551 26315 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:34.795192 26315 heartbeater.cc:511] Master 127.22.49.254:45695 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
I20260811 05:03:34.797281 26097 ts_manager.cc:194] Registered new tserver with Master: 84faf12cd30a4414802c5c81fce93ebd (127.22.49.193:34627)
I20260811 05:03:34.799060 26097 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:41903
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:03:34.820909 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45695
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:34.954447 26321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:34.954820 26321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:34.954872 26321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:34.959852 26321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:34.959960 26321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:34.960110 26321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:03:34.966437 26321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:34.967862 26321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:34.969106 26321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:34.980994 26330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:34.981186 26328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:34.981122 26327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:34.981381 26321 server_base.cc:1034] running on GCE node
I20260811 05:03:34.982147 26321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:34.982906 26321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:34.984169 26321 hybrid_clock.cc:648] HybridClock initialized: now 1786424614984126 us; error 60 us; skew 500 ppm
Aug 11 05:03:34 dist-test-slave-w206 krb5kdc[26050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424614, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:34.987798 26321 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:03:34.988906 26321 webserver.cc:460] Webserver started at http://127.22.49.194:42393/ using document root <none> and password file <none>
I20260811 05:03:34.989540 26321 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:34.989615 26321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:34.989836 26321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:34.992456 26321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "4f9fb221c24a4c16965dfa422c467c5f"
format_stamp: "Formatted at 2026-08-11 05:03:34 on dist-test-slave-w206"
server_key: "4539ae6f3a398dbe909eafc293b06b5a"
server_key_iv: "43075f7999bd2fdf353d68000db20231"
server_key_version: "encryptionkey@0"
I20260811 05:03:34.993122 26321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "4f9fb221c24a4c16965dfa422c467c5f"
format_stamp: "Formatted at 2026-08-11 05:03:34 on dist-test-slave-w206"
server_key: "4539ae6f3a398dbe909eafc293b06b5a"
server_key_iv: "43075f7999bd2fdf353d68000db20231"
server_key_version: "encryptionkey@0"
I20260811 05:03:34.998445 26321 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 05:03:35.002185 26339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:35.004844 26321 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260811 05:03:35.005110 26321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "4f9fb221c24a4c16965dfa422c467c5f"
format_stamp: "Formatted at 2026-08-11 05:03:34 on dist-test-slave-w206"
server_key: "4539ae6f3a398dbe909eafc293b06b5a"
server_key_iv: "43075f7999bd2fdf353d68000db20231"
server_key_version: "encryptionkey@0"
I20260811 05:03:35.005296 26321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:35.026353 26321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:35.030691 26321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:35.030952 26321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:35.031952 26321 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:35.033103 26321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:35.033188 26321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:35.033262 26321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:35.033293 26321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:35.046209 26321 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:41669
I20260811 05:03:35.046237 26467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:41669 every 8 connection(s)
I20260811 05:03:35.047421 26321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:03:35.052052 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 26321
I20260811 05:03:35.052201 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:03:35.052548 22727 external_mini_cluster.cc:1428] Setting key 6f1384451013a794bab485e8b99a4170
Aug 11 05:03:35 dist-test-slave-w206 krb5kdc[26050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424614, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
I20260811 05:03:35.069762 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:35.050091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:39649 (local address 127.22.49.254:45695)
0811 05:03:35.050296 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:35.050302 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:35.051918 (+ 1616us) server_negotiation.cc:407] Connection header received
0811 05:03:35.053966 (+ 2048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:35.054013 (+ 47us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:35.054080 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:35.054172 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:35.056880 (+ 2708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:35.057739 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:35.060386 (+ 2647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:35.060655 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:35.061000 (+ 345us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:35.064563 (+ 3563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:35.064568 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:35.064571 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:35.064613 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:35.066709 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:35.067620 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:35.067624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:35.067625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:35.067719 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:35.068259 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:35.068267 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:35.068268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:35.068527 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:35.068664 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:35.069298 (+ 634us) server_negotiation.cc:299] Negotiation successful
0811 05:03:35.069468 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
I20260811 05:03:35.070844 26471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:35.050562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:45695 (local address 127.22.49.194:39649)
0811 05:03:35.051653 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:35.051725 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:35.053629 (+ 1904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:35.054782 (+ 1153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:35.054799 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:35.055576 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:35.056469 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:35.056494 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:35.058038 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:35.058047 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:35.060125 (+ 2078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:35.060155 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:35.061108 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:35.061117 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:35.061421 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:35.062301 (+ 880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:35.062347 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:35.064157 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:35.067083 (+ 2926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:35.067091 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:35.067116 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:35.067467 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:35.067871 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:35.067873 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:35.067875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:35.068119 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:35.068679 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:35.068689 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:35.069007 (+ 318us) client_negotiation.cc:769] Sending connection context
0811 05:03:35.069222 (+ 215us) client_negotiation.cc:240] Negotiation successful
0811 05:03:35.069650 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":719,"thread_start_us":176,"threads_started":1}
I20260811 05:03:35.072563 26468 heartbeater.cc:347] Connected to a master server at 127.22.49.254:45695
I20260811 05:03:35.072834 26468 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:35.073575 26468 heartbeater.cc:511] Master 127.22.49.254:45695 requested a full tablet report, sending...
I20260811 05:03:35.075145 26097 ts_manager.cc:194] Registered new tserver with Master: 4f9fb221c24a4c16965dfa422c467c5f (127.22.49.194:41669)
I20260811 05:03:35.075790 26097 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:39649
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:03:35.096909 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45695
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:35.231472 26474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:35.231841 26474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:35.231922 26474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:35.236577 26474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:35.236689 26474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:35.236785 26474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:03:35.242698 26474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:35.244030 26474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:35.245184 26474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:35.256345 26481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:35.256345 26483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:35.256376 26479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:35.256724 26474 server_base.cc:1034] running on GCE node
I20260811 05:03:35.257428 26474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:35.258145 26474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:35.259332 26474 hybrid_clock.cc:648] HybridClock initialized: now 1786424615259300 us; error 54 us; skew 500 ppm
Aug 11 05:03:35 dist-test-slave-w206 krb5kdc[26050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424615, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:35.262734 26474 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:03:35.263921 26474 webserver.cc:460] Webserver started at http://127.22.49.195:33651/ using document root <none> and password file <none>
I20260811 05:03:35.264556 26474 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:35.264629 26474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:35.264864 26474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:35.267506 26474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "65970e6f34e34783b1c86be96d1bdc60"
format_stamp: "Formatted at 2026-08-11 05:03:35 on dist-test-slave-w206"
server_key: "97c8d6002f697d1e81c090a34f3bdb2f"
server_key_iv: "d0fddae03d39dd7eb946fb8e90104153"
server_key_version: "encryptionkey@0"
I20260811 05:03:35.268194 26474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "65970e6f34e34783b1c86be96d1bdc60"
format_stamp: "Formatted at 2026-08-11 05:03:35 on dist-test-slave-w206"
server_key: "97c8d6002f697d1e81c090a34f3bdb2f"
server_key_iv: "d0fddae03d39dd7eb946fb8e90104153"
server_key_version: "encryptionkey@0"
I20260811 05:03:35.273209 26474 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 05:03:35.277144 26490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:35.278915 26474 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:35.279160 26474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "65970e6f34e34783b1c86be96d1bdc60"
format_stamp: "Formatted at 2026-08-11 05:03:35 on dist-test-slave-w206"
server_key: "97c8d6002f697d1e81c090a34f3bdb2f"
server_key_iv: "d0fddae03d39dd7eb946fb8e90104153"
server_key_version: "encryptionkey@0"
I20260811 05:03:35.279317 26474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:35.299351 26474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:35.303582 26474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:35.303843 26474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:35.304589 26474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:35.305572 26474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:35.305632 26474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:35.305711 26474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:35.305743 26474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:35.316028 26474 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:39273
I20260811 05:03:35.316118 26617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:39273 every 8 connection(s)
I20260811 05:03:35.317094 26474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:03:35.318176 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 26474
I20260811 05:03:35.318315 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:03:35.318653 22727 external_mini_cluster.cc:1428] Setting key bde2fc2a05435734abeaba896511f105
Aug 11 05:03:35 dist-test-slave-w206 krb5kdc[26050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424615, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:35.334812 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:35.319698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:52741 (local address 127.22.49.254:45695)
0811 05:03:35.319905 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:35.319911 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:35.321215 (+ 1304us) server_negotiation.cc:407] Connection header received
0811 05:03:35.322814 (+ 1599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:35.322817 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:35.322904 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:35.323078 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:35.324491 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:35.325124 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:35.326715 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:35.327061 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:35.327167 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:35.330247 (+ 3080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:35.330251 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:35.330253 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:35.330283 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:35.331957 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:35.332709 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:35.332713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:35.332715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:35.332821 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:35.333347 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:35.333353 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:35.333357 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:35.333670 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:35.333748 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:35.334465 (+ 717us) server_negotiation.cc:299] Negotiation successful
0811 05:03:35.334677 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 05:03:35.335834 26622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:35.320378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:45695 (local address 127.22.49.195:52741)
0811 05:03:35.321040 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:35.321090 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:35.322545 (+ 1455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:35.323258 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:35.323266 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:35.323708 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:35.324296 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:35.324314 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:35.325296 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:35.325300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:35.326516 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:35.326529 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:35.327246 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:35.327249 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:35.327436 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:35.328167 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:35.328185 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:35.329997 (+ 1812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:35.332118 (+ 2121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:35.332125 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:35.332142 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:35.332593 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:35.332974 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:35.332977 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:35.332980 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:35.333222 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:35.333789 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:35.333795 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:35.334166 (+ 371us) client_negotiation.cc:769] Sending connection context
0811 05:03:35.334360 (+ 194us) client_negotiation.cc:240] Negotiation successful
0811 05:03:35.334756 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":207,"threads_started":1}
I20260811 05:03:35.337296 26620 heartbeater.cc:347] Connected to a master server at 127.22.49.254:45695
I20260811 05:03:35.337582 26620 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:35.338183 26620 heartbeater.cc:511] Master 127.22.49.254:45695 requested a full tablet report, sending...
I20260811 05:03:35.339598 26097 ts_manager.cc:194] Registered new tserver with Master: 65970e6f34e34783b1c86be96d1bdc60 (127.22.49.195:39273)
I20260811 05:03:35.340209 26097 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:52741
I20260811 05:03:35.346370 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 05:03:35 dist-test-slave-w206 krb5kdc[26050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424615, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 05:03:35 dist-test-slave-w206 krb5kdc[26050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424615, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:35.376745 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:35.366567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44166 (local address 127.22.49.254:45695)
0811 05:03:35.366718 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:35.366722 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:35.367060 (+ 338us) server_negotiation.cc:407] Connection header received
0811 05:03:35.367150 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:35.367153 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:35.367200 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:35.367270 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:35.368074 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:35.368630 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:35.369583 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:35.369809 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:35.369908 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:35.372843 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:35.372847 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:35.372850 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:35.372886 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:35.374566 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:35.375174 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:35.375177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:35.375179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:35.375269 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:35.375566 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:35.375569 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:35.375570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:35.375830 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:35.375944 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:35.376327 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 05:03:35.376560 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 05:03:35.377525 26097 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:44166
I20260811 05:03:35.378949 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 26166
I20260811 05:03:35.390545 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 26321
I20260811 05:03:35.398432 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 26474
I20260811 05:03:35.406533 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 26063
2026-08-11T05:03:35Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2519 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:03:35 dist-test-slave-w206 krb5kdc[26635](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:03:35 dist-test-slave-w206 krb5kdc[26635](info): set up 2 sockets
Aug 11 05:03:35 dist-test-slave-w206 krb5kdc[26635](info): commencing operation
krb5kdc: starting...
W20260811 05:03:36.616650 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260811 05:03:36.834606 22727 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.218s user 0.000s sys 0.003s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260811 05:03:37.002149 22727 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.167s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260811 05:03:37.251770 22727 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.249s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/test-user.keytab.
W20260811 05:03:37.403803 22727 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.152s user 0.000s sys 0.002s
Aug 11 05:03:37 dist-test-slave-w206 krb5kdc[26635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:03:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:03:37.464133 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:40349
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:40795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:40349
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:37.594846 26648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:37.595222 26648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:37.595266 26648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:37.599704 26648 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:37.599828 26648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:37.599851 26648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:37.599869 26648 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:37.599885 26648 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:03:37.605963 26648 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:40795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:40349
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:40349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:37.607360 26648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:37.608590 26648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:37.618578 26653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:37.618573 26654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:37.618661 26648 server_base.cc:1034] running on GCE node
W20260811 05:03:37.618510 26656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:37.619545 26648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:37.620875 26648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:37.622110 26648 hybrid_clock.cc:648] HybridClock initialized: now 1786424617622080 us; error 55 us; skew 500 ppm
Aug 11 05:03:37 dist-test-slave-w206 krb5kdc[26635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424617, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:37.625504 26648 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:03:37.626690 26648 webserver.cc:460] Webserver started at http://127.22.49.254:44397/ using document root <none> and password file <none>
I20260811 05:03:37.627445 26648 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:37.627556 26648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:37.627815 26648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:37.630187 26648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "28efdc018c1646858045fe3dcd1c9cde"
format_stamp: "Formatted at 2026-08-11 05:03:37 on dist-test-slave-w206"
server_key: "007fe23ff39bc220ceb9a070afb6e522"
server_key_iv: "1bdae71b31dd598e8ff2b70c1bd0ee0b"
server_key_version: "encryptionkey@0"
I20260811 05:03:37.630859 26648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "28efdc018c1646858045fe3dcd1c9cde"
format_stamp: "Formatted at 2026-08-11 05:03:37 on dist-test-slave-w206"
server_key: "007fe23ff39bc220ceb9a070afb6e522"
server_key_iv: "1bdae71b31dd598e8ff2b70c1bd0ee0b"
server_key_version: "encryptionkey@0"
I20260811 05:03:37.635790 26648 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260811 05:03:37.639200 26663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:37.640805 26648 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:03:37.641012 26648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "28efdc018c1646858045fe3dcd1c9cde"
format_stamp: "Formatted at 2026-08-11 05:03:37 on dist-test-slave-w206"
server_key: "007fe23ff39bc220ceb9a070afb6e522"
server_key_iv: "1bdae71b31dd598e8ff2b70c1bd0ee0b"
server_key_version: "encryptionkey@0"
I20260811 05:03:37.641170 26648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:37.663311 26648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:37.667469 26648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:37.667718 26648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:37.676290 26648 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:40349
I20260811 05:03:37.676465 26721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:40349 every 8 connection(s)
I20260811 05:03:37.677466 26648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:37.680872 26722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:37.683686 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 26648
I20260811 05:03:37.683828 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:37.684124 22727 external_mini_cluster.cc:1428] Setting key 2a55c815d9b1e80ae4938a5a859ccf08
I20260811 05:03:37.689003 26722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde: Bootstrap starting.
I20260811 05:03:37.692109 26722 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:37.693095 26722 log.cc:824] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde: Log is configured to *not* fsync() on all Append() calls
Aug 11 05:03:37 dist-test-slave-w206 krb5kdc[26635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:37.695835 26722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde: No bootstrap required, opened a new log
I20260811 05:03:37.700915 26722 raft_consensus.cc:348] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28efdc018c1646858045fe3dcd1c9cde" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40349 } }
I20260811 05:03:37.701251 26722 raft_consensus.cc:374] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:37.701308 26722 raft_consensus.cc:729] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28efdc018c1646858045fe3dcd1c9cde, State: Initialized, Role: FOLLOWER
I20260811 05:03:37.701896 26722 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28efdc018c1646858045fe3dcd1c9cde" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40349 } }
I20260811 05:03:37.702112 26722 raft_consensus.cc:388] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:37.702198 26722 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:37.702308 26722 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:37.703709 26725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:37.685941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39628 (local address 127.22.49.254:40349)
0811 05:03:37.686522 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:37.686545 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:37.686597 (+ 52us) server_negotiation.cc:407] Connection header received
0811 05:03:37.687617 (+ 1020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:37.687649 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:37.688197 (+ 548us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:37.688628 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:37.689666 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:37.691224 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:37.692228 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:37.692975 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:37.693148 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:37.696177 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:37.696184 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:37.696203 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:37.696241 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:37.699531 (+ 3290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:37.700211 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:37.700220 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:37.700228 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:37.700411 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:37.700722 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:37.700726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:37.700727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:37.701318 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:37.701542 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:37.701872 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 05:03:37.702232 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":159,"threads_started":1}
I20260811 05:03:37.704034 26722 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28efdc018c1646858045fe3dcd1c9cde" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40349 } }
I20260811 05:03:37.704454 26722 leader_election.cc:302] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28efdc018c1646858045fe3dcd1c9cde; no voters:
I20260811 05:03:37.704836 26722 leader_election.cc:288] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:37.704968 26727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:37.705224 26727 raft_consensus.cc:686] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [term 1 LEADER]: Becoming Leader. State: Replica: 28efdc018c1646858045fe3dcd1c9cde, State: Running, Role: LEADER
I20260811 05:03:37.705669 26727 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28efdc018c1646858045fe3dcd1c9cde" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40349 } }
I20260811 05:03:37.706350 26722 sys_catalog.cc:564] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:37.706977 26727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "28efdc018c1646858045fe3dcd1c9cde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28efdc018c1646858045fe3dcd1c9cde" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40349 } } }
I20260811 05:03:37.707237 26727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:37.707475 26728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28efdc018c1646858045fe3dcd1c9cde. Latest consensus state: current_term: 1 leader_uuid: "28efdc018c1646858045fe3dcd1c9cde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28efdc018c1646858045fe3dcd1c9cde" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40349 } } }
I20260811 05:03:37.707597 26728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde [sys.catalog]: This master's current role is: LEADER
W20260811 05:03:37.712062 26743 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:03:37.712205 26743 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:03:37.712296 26734 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:37.713032 26734 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:37.719455 26734 catalog_manager.cc:1347] Generated new cluster ID: 8c3f80a77a534cf790f55f18a44bfeef
I20260811 05:03:37.719558 26734 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:37.732744 26734 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:37.734650 26734 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:37.743968 26734 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 28efdc018c1646858045fe3dcd1c9cde: Generated new TSK 0
I20260811 05:03:37.744777 26734 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:03:37.787757 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40349
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:40795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:37.913384 26748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:37.913710 26748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:37.913759 26748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:37.918164 26748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:37.918255 26748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:37.918319 26748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:03:37.924332 26748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:40795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:37.925618 26748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:37.926751 26748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:37.937543 26755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:37.937562 26757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:37.937543 26754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:37.937685 26748 server_base.cc:1034] running on GCE node
I20260811 05:03:37.938423 26748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:37.939224 26748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:37.940436 26748 hybrid_clock.cc:648] HybridClock initialized: now 1786424617940395 us; error 59 us; skew 500 ppm
Aug 11 05:03:37 dist-test-slave-w206 krb5kdc[26635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424617, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:37.943871 26748 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:03:37.944875 26748 webserver.cc:460] Webserver started at http://127.22.49.193:40593/ using document root <none> and password file <none>
I20260811 05:03:37.945549 26748 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:37.945647 26748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:37.945886 26748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:37.948222 26748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "e8a0c97f322d492ca1f8a5d624ece3a5"
format_stamp: "Formatted at 2026-08-11 05:03:37 on dist-test-slave-w206"
server_key: "8151f49f067ebd4762a5238f61d3cdd4"
server_key_iv: "c885e663b6dc7a648776e9afaeb6808b"
server_key_version: "encryptionkey@0"
I20260811 05:03:37.948871 26748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "e8a0c97f322d492ca1f8a5d624ece3a5"
format_stamp: "Formatted at 2026-08-11 05:03:37 on dist-test-slave-w206"
server_key: "8151f49f067ebd4762a5238f61d3cdd4"
server_key_iv: "c885e663b6dc7a648776e9afaeb6808b"
server_key_version: "encryptionkey@0"
I20260811 05:03:37.953045 26748 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:03:37.955892 26766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:37.957181 26748 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:03:37.957367 26748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "e8a0c97f322d492ca1f8a5d624ece3a5"
format_stamp: "Formatted at 2026-08-11 05:03:37 on dist-test-slave-w206"
server_key: "8151f49f067ebd4762a5238f61d3cdd4"
server_key_iv: "c885e663b6dc7a648776e9afaeb6808b"
server_key_version: "encryptionkey@0"
I20260811 05:03:37.957495 26748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:37.969457 26748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:37.973735 26748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:37.973979 26748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:37.974817 26748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:37.976264 26748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:37.976347 26748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:37.976425 26748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:37.976462 26748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:37.989871 26748 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:37799
I20260811 05:03:37.989953 26892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:37799 every 8 connection(s)
I20260811 05:03:37.991200 26748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:03:37.996773 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 26748
I20260811 05:03:37.996929 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:03:37.997268 22727 external_mini_cluster.cc:1428] Setting key ab7bdeb52c54976d488f09a54bf9e7fe
Aug 11 05:03:38 dist-test-slave-w206 krb5kdc[26635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424617, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:03:38.013446 26725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:37.995158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:40073 (local address 127.22.49.254:40349)
0811 05:03:37.995346 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:37.995353 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:37.995380 (+ 27us) server_negotiation.cc:407] Connection header received
0811 05:03:37.996267 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:37.996272 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:37.996344 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:37.996493 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:37.998535 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:37.999522 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:38.001554 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:38.002109 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:38.002261 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:38.007275 (+ 5014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:38.007283 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:38.007288 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:38.007335 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:38.009508 (+ 2173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:38.010451 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:38.010456 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:38.010457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:38.010570 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:38.011028 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:38.011032 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:38.011034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:38.011680 (+ 646us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:38.011890 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:38.013033 (+ 1143us) server_negotiation.cc:299] Negotiation successful
0811 05:03:38.013252 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 05:03:38.014398 26895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:37.993840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:40349 (local address 127.22.49.193:40073)
0811 05:03:37.994477 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:37.994527 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:37.996017 (+ 1490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:37.996898 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:37.996911 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:37.997486 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:37.998275 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:37.998309 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:37.999721 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:37.999727 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:38.001293 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:38.001312 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:38.002355 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:38.002363 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:38.002631 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:38.003515 (+ 884us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:38.003547 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:38.006880 (+ 3333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:38.009698 (+ 2818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:38.009705 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:38.009752 (+ 47us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:38.010311 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:38.010685 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:38.010689 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:38.010691 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:38.010883 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:38.011891 (+ 1008us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:38.011901 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:38.012336 (+ 435us) client_negotiation.cc:769] Sending connection context
0811 05:03:38.012602 (+ 266us) client_negotiation.cc:240] Negotiation successful
0811 05:03:38.013060 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":171,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
I20260811 05:03:38.016290 26893 heartbeater.cc:347] Connected to a master server at 127.22.49.254:40349
I20260811 05:03:38.016618 26893 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:38.017429 26893 heartbeater.cc:511] Master 127.22.49.254:40349 requested a full tablet report, sending...
I20260811 05:03:38.020290 26681 ts_manager.cc:194] Registered new tserver with Master: e8a0c97f322d492ca1f8a5d624ece3a5 (127.22.49.193:37799)
I20260811 05:03:38.022409 26681 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:40073
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:03:38.043648 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40349
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:40795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:38.173703 26899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:38.174058 26899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:38.174108 26899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:38.179829 26899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:38.179941 26899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:38.180030 26899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:03:38.186257 26899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:40795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:38.187582 26899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:38.189060 26899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:38.201462 26904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:38.202366 26908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:38.202558 26905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:38.202669 26899 server_base.cc:1034] running on GCE node
I20260811 05:03:38.203261 26899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:38.204082 26899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:38.207599 26899 hybrid_clock.cc:648] HybridClock initialized: now 1786424618207424 us; error 146 us; skew 500 ppm
Aug 11 05:03:38 dist-test-slave-w206 krb5kdc[26635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424618, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:38.212025 26899 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:03:38.213205 26899 webserver.cc:460] Webserver started at http://127.22.49.194:36311/ using document root <none> and password file <none>
I20260811 05:03:38.213893 26899 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:38.214020 26899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:38.214293 26899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:38.217474 26899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "b3d5cc718f9549d9885f32718280e80e"
format_stamp: "Formatted at 2026-08-11 05:03:38 on dist-test-slave-w206"
server_key: "117e4dda20b11e7e7dea83d84587cc37"
server_key_iv: "428d37c4309b3f6718477bb7d23b86f9"
server_key_version: "encryptionkey@0"
I20260811 05:03:38.218263 26899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "b3d5cc718f9549d9885f32718280e80e"
format_stamp: "Formatted at 2026-08-11 05:03:38 on dist-test-slave-w206"
server_key: "117e4dda20b11e7e7dea83d84587cc37"
server_key_iv: "428d37c4309b3f6718477bb7d23b86f9"
server_key_version: "encryptionkey@0"
I20260811 05:03:38.223971 26899 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 05:03:38.228037 26916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:38.229796 26899 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:03:38.230037 26899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "b3d5cc718f9549d9885f32718280e80e"
format_stamp: "Formatted at 2026-08-11 05:03:38 on dist-test-slave-w206"
server_key: "117e4dda20b11e7e7dea83d84587cc37"
server_key_iv: "428d37c4309b3f6718477bb7d23b86f9"
server_key_version: "encryptionkey@0"
I20260811 05:03:38.230216 26899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:38.259220 26899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:38.264344 26899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:38.264607 26899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:38.265341 26899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:38.266340 26899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:38.266391 26899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:38.266460 26899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:38.266494 26899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:38.279457 26899 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:34765
I20260811 05:03:38.279506 27040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:34765 every 8 connection(s)
I20260811 05:03:38.280624 26899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:03:38.283877 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 26899
I20260811 05:03:38.284021 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:03:38.284363 22727 external_mini_cluster.cc:1428] Setting key 3b5467f00a9b345457c0a9f26fade61d
Aug 11 05:03:38 dist-test-slave-w206 krb5kdc[26635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424618, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
I20260811 05:03:38.300748 26725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:38.282897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:60531 (local address 127.22.49.254:40349)
0811 05:03:38.283134 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:38.283139 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:38.284497 (+ 1358us) server_negotiation.cc:407] Connection header received
0811 05:03:38.286350 (+ 1853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:38.286354 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:38.286415 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:38.286531 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:38.288173 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:38.289008 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:38.291295 (+ 2287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:38.291801 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:38.291957 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:38.295788 (+ 3831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:38.295792 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:38.295794 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:38.295827 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:38.297960 (+ 2133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:38.298738 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:38.298742 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:38.298743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:38.298845 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:38.299303 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:38.299307 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:38.299309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:38.299537 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:38.299661 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:38.300391 (+ 730us) server_negotiation.cc:299] Negotiation successful
0811 05:03:38.300566 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
I20260811 05:03:38.301947 27043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:38.283451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:40349 (local address 127.22.49.194:60531)
0811 05:03:38.284229 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:38.284288 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:38.286085 (+ 1797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:38.286739 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:38.286749 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:38.287286 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:38.287950 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:38.287967 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:38.289231 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:38.289236 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:38.290922 (+ 1686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:38.290944 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:38.292074 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:38.292082 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:38.292379 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:38.293312 (+ 933us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:38.293342 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:38.295498 (+ 2156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:38.298150 (+ 2652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:38.298159 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:38.298191 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:38.298589 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:38.298957 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:38.298960 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:38.298963 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:38.299181 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:38.299662 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:38.299671 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:38.300024 (+ 353us) client_negotiation.cc:769] Sending connection context
0811 05:03:38.300336 (+ 312us) client_negotiation.cc:240] Negotiation successful
0811 05:03:38.300799 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":194,"threads_started":1}
I20260811 05:03:38.303781 27041 heartbeater.cc:347] Connected to a master server at 127.22.49.254:40349
I20260811 05:03:38.304113 27041 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:38.305172 27041 heartbeater.cc:511] Master 127.22.49.254:40349 requested a full tablet report, sending...
I20260811 05:03:38.307569 26681 ts_manager.cc:194] Registered new tserver with Master: b3d5cc718f9549d9885f32718280e80e (127.22.49.194:34765)
I20260811 05:03:38.308368 26681 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:60531
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:03:38.328354 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40349
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:40795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:38.461112 27046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:38.461619 27046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:38.461719 27046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:38.466394 27046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:38.466511 27046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:38.466579 27046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:03:38.475309 27046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:40795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:38.476714 27046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:38.478009 27046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:38.491158 27052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:38.491124 27051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:38.491124 27054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:38.491175 27046 server_base.cc:1034] running on GCE node
I20260811 05:03:38.492107 27046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:38.493127 27046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:38.496805 27046 hybrid_clock.cc:648] HybridClock initialized: now 1786424618496530 us; error 194 us; skew 500 ppm
Aug 11 05:03:38 dist-test-slave-w206 krb5kdc[26635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424618, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:38.502422 27046 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:03:38.504387 27046 webserver.cc:460] Webserver started at http://127.22.49.195:43171/ using document root <none> and password file <none>
I20260811 05:03:38.505117 27046 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:38.505203 27046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:38.505609 27046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:38.509125 27046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "e1488bc6aa4d4faeae66dfd07a665315"
format_stamp: "Formatted at 2026-08-11 05:03:38 on dist-test-slave-w206"
server_key: "3ffe37d6ba1cddbecf6fbab8b461938a"
server_key_iv: "ce56d6a8132903f6fce5cb5b3073c558"
server_key_version: "encryptionkey@0"
I20260811 05:03:38.509814 27046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "e1488bc6aa4d4faeae66dfd07a665315"
format_stamp: "Formatted at 2026-08-11 05:03:38 on dist-test-slave-w206"
server_key: "3ffe37d6ba1cddbecf6fbab8b461938a"
server_key_iv: "ce56d6a8132903f6fce5cb5b3073c558"
server_key_version: "encryptionkey@0"
I20260811 05:03:38.514674 27046 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 05:03:38.518002 27061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:38.520681 27046 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 05:03:38.520900 27046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "e1488bc6aa4d4faeae66dfd07a665315"
format_stamp: "Formatted at 2026-08-11 05:03:38 on dist-test-slave-w206"
server_key: "3ffe37d6ba1cddbecf6fbab8b461938a"
server_key_iv: "ce56d6a8132903f6fce5cb5b3073c558"
server_key_version: "encryptionkey@0"
I20260811 05:03:38.521237 27046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:38.559244 27046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:38.563966 27046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:38.564229 27046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:38.564960 27046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:38.565984 27046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:38.566038 27046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:38.566083 27046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:38.566138 27046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:38.576747 27046 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:44927
I20260811 05:03:38.576884 27192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:44927 every 8 connection(s)
I20260811 05:03:38.577991 27046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:03:38.580274 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 27046
I20260811 05:03:38.580474 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:03:38.580866 22727 external_mini_cluster.cc:1428] Setting key 15d41dfc9036f794e54590929e4bb9a0
Aug 11 05:03:38 dist-test-slave-w206 krb5kdc[26635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424618, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:38.598275 26725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:38.580830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:36927 (local address 127.22.49.254:40349)
0811 05:03:38.581008 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:38.581013 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:38.582466 (+ 1453us) server_negotiation.cc:407] Connection header received
0811 05:03:38.584363 (+ 1897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:38.584367 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:38.584436 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:38.584526 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:38.586004 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:38.586572 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:38.587959 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:38.588207 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:38.588342 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:38.591900 (+ 3558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:38.591905 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:38.591907 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:38.591963 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:38.594092 (+ 2129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:38.596039 (+ 1947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:38.596045 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:38.596048 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:38.596174 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:38.596703 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:38.596707 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:38.596709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:38.597005 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:38.597094 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:38.598010 (+ 916us) server_negotiation.cc:299] Negotiation successful
0811 05:03:38.598143 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 05:03:38.599846 27195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:38.581459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:40349 (local address 127.22.49.195:36927)
0811 05:03:38.582195 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:38.582309 (+ 114us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:38.584096 (+ 1787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:38.584773 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:38.584781 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:38.585245 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:38.585801 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:38.585817 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:38.586731 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:38.586736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:38.587784 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:38.587798 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:38.588401 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:38.588406 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:38.588629 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:38.589385 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:38.589405 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:38.591626 (+ 2221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:38.594483 (+ 2857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:38.594490 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:38.594522 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:38.595709 (+ 1187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:38.596302 (+ 593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:38.596307 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:38.596308 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:38.596510 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:38.597229 (+ 719us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:38.597238 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:38.597599 (+ 361us) client_negotiation.cc:769] Sending connection context
0811 05:03:38.597796 (+ 197us) client_negotiation.cc:240] Negotiation successful
0811 05:03:38.598134 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":281,"threads_started":1}
I20260811 05:03:38.601601 27193 heartbeater.cc:347] Connected to a master server at 127.22.49.254:40349
I20260811 05:03:38.601909 27193 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:38.602514 27193 heartbeater.cc:511] Master 127.22.49.254:40349 requested a full tablet report, sending...
I20260811 05:03:38.603906 26681 ts_manager.cc:194] Registered new tserver with Master: e1488bc6aa4d4faeae66dfd07a665315 (127.22.49.195:44927)
I20260811 05:03:38.604622 26681 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:36927
I20260811 05:03:38.610518 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 05:03:38 dist-test-slave-w206 krb5kdc[26635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 05:03:38 dist-test-slave-w206 krb5kdc[26635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.193@KRBTEST.COM
I20260811 05:03:38.649199 27200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:38.634585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34788 (local address 127.22.49.193:37799)
0811 05:03:38.635047 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:38.635055 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:38.635090 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:03:38.635240 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:38.635268 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:38.635623 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:38.635923 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:38.637174 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:38.638046 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:38.639203 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:38.639739 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:38.639882 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:38.643119 (+ 3237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:38.643144 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:38.643163 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:38.643222 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:38.645746 (+ 2524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:38.646713 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:38.646720 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:38.646721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:38.646860 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:38.647365 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:38.647369 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:38.647371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:38.647694 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:38.647931 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:38.648625 (+ 694us) server_negotiation.cc:299] Negotiation successful
0811 05:03:38.649026 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":96,"threads_started":1}
Aug 11 05:03:38 dist-test-slave-w206 krb5kdc[26635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:38.664693 26725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:38.653573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39644 (local address 127.22.49.254:40349)
0811 05:03:38.653751 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:38.653755 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:38.653773 (+ 18us) server_negotiation.cc:407] Connection header received
0811 05:03:38.653875 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:38.653877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:38.653928 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:38.654017 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:38.654818 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:38.655537 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:38.656698 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:38.656943 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:38.657051 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:38.660406 (+ 3355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:38.660410 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:38.660412 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:38.660452 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:38.662453 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:38.663179 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:38.663182 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:38.663183 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:38.663289 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:38.663693 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:38.663695 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:38.663696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:38.664000 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:38.664126 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:38.664389 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 05:03:38.664518 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 05:03:38.665205 26681 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39644
I20260811 05:03:38.666298 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 26748
I20260811 05:03:38.676049 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 26899
I20260811 05:03:38.684675 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 27046
I20260811 05:03:38.694123 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 26648
2026-08-11T05:03:38Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3286 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:03:38 dist-test-slave-w206 krb5kdc[27205](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:03:38 dist-test-slave-w206 krb5kdc[27205](info): set up 2 sockets
Aug 11 05:03:38 dist-test-slave-w206 krb5kdc[27205](info): commencing operation
krb5kdc: starting...
W20260811 05:03:39.847769 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:03:39 dist-test-slave-w206 krb5kdc[27205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:03:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:03:39.999713 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:44931
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:44931
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:40.126448 27220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:40.126776 27220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:40.126832 27220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:40.131268 27220 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:40.131357 27220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:40.131378 27220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:40.131397 27220 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:40.131412 27220 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:03:40.137356 27220 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:44931
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:44931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:40.138664 27220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:40.139844 27220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:40.150456 27230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:40.150542 27226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:40.150542 27227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:40.150728 27220 server_base.cc:1034] running on GCE node
I20260811 05:03:40.151664 27220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:40.152979 27220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:40.154228 27220 hybrid_clock.cc:648] HybridClock initialized: now 1786424620154182 us; error 74 us; skew 500 ppm
Aug 11 05:03:40 dist-test-slave-w206 krb5kdc[27205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424620, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:40.164098 27220 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:03:40.165256 27220 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:40.165383 27220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:40.165657 27220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:40.168337 27220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "b6416b17b1af474ca9066f6ec73d73ad"
format_stamp: "Formatted at 2026-08-11 05:03:40 on dist-test-slave-w206"
server_key: "6854bce5332cbb18edb8aad75b2c995a"
server_key_iv: "0732f604b977268fec9fb877083cd671"
server_key_version: "encryptionkey@0"
I20260811 05:03:40.169023 27220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "b6416b17b1af474ca9066f6ec73d73ad"
format_stamp: "Formatted at 2026-08-11 05:03:40 on dist-test-slave-w206"
server_key: "6854bce5332cbb18edb8aad75b2c995a"
server_key_iv: "0732f604b977268fec9fb877083cd671"
server_key_version: "encryptionkey@0"
I20260811 05:03:40.173549 27220 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:03:40.176656 27236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:40.178474 27220 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 05:03:40.178685 27220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "b6416b17b1af474ca9066f6ec73d73ad"
format_stamp: "Formatted at 2026-08-11 05:03:40 on dist-test-slave-w206"
server_key: "6854bce5332cbb18edb8aad75b2c995a"
server_key_iv: "0732f604b977268fec9fb877083cd671"
server_key_version: "encryptionkey@0"
I20260811 05:03:40.178838 27220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:40.211735 27220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:40.215572 27220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:40.215811 27220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:40.223920 27220 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:44931
I20260811 05:03:40.224248 27295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:44931 every 8 connection(s)
I20260811 05:03:40.224701 27220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:40.227784 27296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:40.229167 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 27220
I20260811 05:03:40.229288 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:40.229607 22727 external_mini_cluster.cc:1428] Setting key 427e96cf19069132c79280fd7106b370
I20260811 05:03:40.236465 27296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad: Bootstrap starting.
I20260811 05:03:40.239930 27296 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:40.241020 27296 log.cc:824] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad: Log is configured to *not* fsync() on all Append() calls
Aug 11 05:03:40 dist-test-slave-w206 krb5kdc[27205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:40.243650 27296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad: No bootstrap required, opened a new log
I20260811 05:03:40.248219 27299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:40.231360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54712 (local address 127.22.49.254:44931)
0811 05:03:40.232207 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:40.232227 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:40.232295 (+ 68us) server_negotiation.cc:407] Connection header received
0811 05:03:40.233451 (+ 1156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:40.233500 (+ 49us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:40.234086 (+ 586us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:40.234549 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:40.235833 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:40.237404 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:40.238422 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:40.239242 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:40.239432 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:40.242825 (+ 3393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:40.242833 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:40.242849 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:40.242885 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:40.244882 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:40.245497 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:40.245502 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:40.245507 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:40.245630 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:40.245991 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:40.245993 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:40.245994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:40.246443 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:40.246593 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:40.246920 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 05:03:40.247358 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":199,"threads_started":1}
I20260811 05:03:40.248154 27296 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6416b17b1af474ca9066f6ec73d73ad" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44931 } }
I20260811 05:03:40.248468 27296 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:40.248533 27296 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6416b17b1af474ca9066f6ec73d73ad, State: Initialized, Role: FOLLOWER
I20260811 05:03:40.248965 27296 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6416b17b1af474ca9066f6ec73d73ad" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44931 } }
I20260811 05:03:40.249090 27296 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:40.249133 27296 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:40.249200 27296 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:40.250279 27296 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6416b17b1af474ca9066f6ec73d73ad" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44931 } }
I20260811 05:03:40.250656 27296 leader_election.cc:302] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6416b17b1af474ca9066f6ec73d73ad; no voters:
I20260811 05:03:40.251053 27296 leader_election.cc:288] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:40.251171 27301 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:40.251418 27301 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [term 1 LEADER]: Becoming Leader. State: Replica: b6416b17b1af474ca9066f6ec73d73ad, State: Running, Role: LEADER
I20260811 05:03:40.251747 27301 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6416b17b1af474ca9066f6ec73d73ad" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44931 } }
I20260811 05:03:40.252485 27296 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:40.253572 27303 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6416b17b1af474ca9066f6ec73d73ad. Latest consensus state: current_term: 1 leader_uuid: "b6416b17b1af474ca9066f6ec73d73ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6416b17b1af474ca9066f6ec73d73ad" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44931 } } }
I20260811 05:03:40.253736 27303 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:40.254189 27310 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:40.254132 27302 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6416b17b1af474ca9066f6ec73d73ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6416b17b1af474ca9066f6ec73d73ad" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44931 } } }
I20260811 05:03:40.254921 27302 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:40.257674 27310 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:40.263916 27310 catalog_manager.cc:1347] Generated new cluster ID: d8df4e4fafc94025a4a1d87c845c231d
I20260811 05:03:40.264016 27310 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:40.273790 27310 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:40.275395 27310 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:40.285883 27310 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad: Generated new TSK 0
I20260811 05:03:40.286916 27310 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:03:40.331651 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44931
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:40.452687 27322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:40.453126 27322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:40.453217 27322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:40.457743 27322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:40.457875 27322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:40.457978 27322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:03:40.464049 27322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:40.465544 27322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:40.466717 27322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:40.477480 27333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:40.477501 27330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:40.477480 27331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:40.477712 27322 server_base.cc:1034] running on GCE node
I20260811 05:03:40.478338 27322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:40.479166 27322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:40.480371 27322 hybrid_clock.cc:648] HybridClock initialized: now 1786424620480359 us; error 39 us; skew 500 ppm
Aug 11 05:03:40 dist-test-slave-w206 krb5kdc[27205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424620, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:40.484172 27322 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:03:40.485137 27322 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:40.485247 27322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:40.485510 27322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:40.487849 27322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "42b9d39bc6de411eab0eb7e48934b873"
format_stamp: "Formatted at 2026-08-11 05:03:40 on dist-test-slave-w206"
server_key: "87aac25b7f8e781134b18f17cf0ed85f"
server_key_iv: "b09e043303369beb1536e554c967cba8"
server_key_version: "encryptionkey@0"
I20260811 05:03:40.488498 27322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "42b9d39bc6de411eab0eb7e48934b873"
format_stamp: "Formatted at 2026-08-11 05:03:40 on dist-test-slave-w206"
server_key: "87aac25b7f8e781134b18f17cf0ed85f"
server_key_iv: "b09e043303369beb1536e554c967cba8"
server_key_version: "encryptionkey@0"
I20260811 05:03:40.492689 27322 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:03:40.495630 27340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:40.497079 27322 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:03:40.497267 27322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "42b9d39bc6de411eab0eb7e48934b873"
format_stamp: "Formatted at 2026-08-11 05:03:40 on dist-test-slave-w206"
server_key: "87aac25b7f8e781134b18f17cf0ed85f"
server_key_iv: "b09e043303369beb1536e554c967cba8"
server_key_version: "encryptionkey@0"
I20260811 05:03:40.497414 27322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:40.530777 27322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:40.534288 27322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:40.534555 27322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:40.535283 27322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:40.536217 27322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:40.536291 27322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:40.536365 27322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:40.536417 27322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:40.546164 27322 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:39839
I20260811 05:03:40.546182 27468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:39839 every 8 connection(s)
I20260811 05:03:40.546921 27322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:03:40.551139 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 27322
I20260811 05:03:40.551299 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:03:40.551654 22727 external_mini_cluster.cc:1428] Setting key ad80e87155a4523b1e9ba53de524f275
Aug 11 05:03:40 dist-test-slave-w206 krb5kdc[27205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424620, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:03:40.563251 27299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:40.548923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:37639 (local address 127.22.49.254:44931)
0811 05:03:40.549111 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:40.549115 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:40.550007 (+ 892us) server_negotiation.cc:407] Connection header received
0811 05:03:40.551624 (+ 1617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:40.551628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:40.551688 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:40.551801 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:40.553419 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:40.553962 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:40.555307 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:40.555551 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:40.555670 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:40.558850 (+ 3180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:40.558854 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:40.558856 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:40.558884 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:40.560569 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:40.561338 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:40.561340 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:40.561342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:40.561421 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:40.561851 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:40.561853 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:40.561854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:40.562068 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:40.562144 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:40.562951 (+ 807us) server_negotiation.cc:299] Negotiation successful
0811 05:03:40.563117 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260811 05:03:40.564299 27471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:40.549320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:44931 (local address 127.22.49.193:37639)
0811 05:03:40.549822 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:40.549876 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:40.551374 (+ 1498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:40.552048 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:40.552062 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:40.552595 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:40.553263 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:40.553281 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:40.554098 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:40.554101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:40.555178 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:40.555189 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:40.555717 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:40.555721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:40.555915 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:40.556581 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:40.556599 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:40.558600 (+ 2001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:40.560720 (+ 2120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:40.560730 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:40.560754 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:40.561214 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:40.561520 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:40.561526 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:40.561530 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:40.561748 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:40.562189 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:40.562200 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:40.562614 (+ 414us) client_negotiation.cc:769] Sending connection context
0811 05:03:40.562873 (+ 259us) client_negotiation.cc:240] Negotiation successful
0811 05:03:40.563324 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":146,"threads_started":1}
I20260811 05:03:40.565730 27469 heartbeater.cc:347] Connected to a master server at 127.22.49.254:44931
I20260811 05:03:40.566025 27469 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
I20260811 05:03:40.566639 27469 heartbeater.cc:511] Master 127.22.49.254:44931 requested a full tablet report, sending...
I20260811 05:03:40.568431 27255 ts_manager.cc:194] Registered new tserver with Master: 42b9d39bc6de411eab0eb7e48934b873 (127.22.49.193:39839)
I20260811 05:03:40.569788 27255 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:37639
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:03:40.586326 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44931
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:40.711177 27474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:40.711496 27474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:40.711545 27474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:40.716022 27474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:40.716132 27474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:40.716264 27474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:03:40.723279 27474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:40.724570 27474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:40.725706 27474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:40.736735 27481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:40.736735 27484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:40.736734 27480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:40.737250 27474 server_base.cc:1034] running on GCE node
I20260811 05:03:40.737843 27474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:40.738628 27474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:40.739835 27474 hybrid_clock.cc:648] HybridClock initialized: now 1786424620739795 us; error 53 us; skew 500 ppm
Aug 11 05:03:40 dist-test-slave-w206 krb5kdc[27205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424620, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:40.743204 27474 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:03:40.744119 27474 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:40.744225 27474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:40.744495 27474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:40.746830 27474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "cb42a3929e9143e38ae38dfe157a51a6"
format_stamp: "Formatted at 2026-08-11 05:03:40 on dist-test-slave-w206"
server_key: "cb26eb4edaa27639d553fa51e8d995b2"
server_key_iv: "c10d1f245063a1092b4266e6fd98a30c"
server_key_version: "encryptionkey@0"
I20260811 05:03:40.747535 27474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "cb42a3929e9143e38ae38dfe157a51a6"
format_stamp: "Formatted at 2026-08-11 05:03:40 on dist-test-slave-w206"
server_key: "cb26eb4edaa27639d553fa51e8d995b2"
server_key_iv: "c10d1f245063a1092b4266e6fd98a30c"
server_key_version: "encryptionkey@0"
I20260811 05:03:40.751776 27474 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 05:03:40.754671 27490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:40.756165 27474 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 05:03:40.756333 27474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "cb42a3929e9143e38ae38dfe157a51a6"
format_stamp: "Formatted at 2026-08-11 05:03:40 on dist-test-slave-w206"
server_key: "cb26eb4edaa27639d553fa51e8d995b2"
server_key_iv: "c10d1f245063a1092b4266e6fd98a30c"
server_key_version: "encryptionkey@0"
I20260811 05:03:40.756475 27474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:40.784134 27474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:40.788183 27474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:40.788364 27474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:40.789054 27474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:40.790032 27474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:40.790092 27474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:40.790138 27474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:40.790153 27474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:40.801789 27474 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:35201
I20260811 05:03:40.801812 27621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:35201 every 8 connection(s)
I20260811 05:03:40.802634 27474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:03:40.805706 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 27474
I20260811 05:03:40.805876 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:03:40.806206 22727 external_mini_cluster.cc:1428] Setting key e10cc164f0885c13ff79d07bc2f3bf98
Aug 11 05:03:40 dist-test-slave-w206 krb5kdc[27205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424620, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
I20260811 05:03:40.821334 27299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:40.804695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:50377 (local address 127.22.49.254:44931)
0811 05:03:40.804846 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:40.804850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:40.805825 (+ 975us) server_negotiation.cc:407] Connection header received
0811 05:03:40.807541 (+ 1716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:40.807544 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:40.807599 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:40.807681 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:40.808911 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:40.809442 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:40.811333 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:40.811568 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:40.811658 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:40.815901 (+ 4243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:40.815905 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:40.815907 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:40.815936 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:40.817661 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:40.818407 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:40.818419 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:40.818420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:40.818504 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:40.818899 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:40.818902 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:40.818904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:40.819222 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:40.819377 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:40.820953 (+ 1576us) server_negotiation.cc:299] Negotiation successful
0811 05:03:40.821176 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
I20260811 05:03:40.822513 27624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:40.805114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:44931 (local address 127.22.49.194:50377)
0811 05:03:40.805650 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:40.805697 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:40.807299 (+ 1602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:40.807867 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:40.807875 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:40.808261 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:40.808757 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:40.808770 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:40.809575 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:40.809579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:40.811176 (+ 1597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:40.811190 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:40.811786 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:40.811794 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:40.812316 (+ 522us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:40.813589 (+ 1273us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:40.813619 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:40.815663 (+ 2044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:40.817838 (+ 2175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:40.817846 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:40.817867 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:40.818273 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:40.818609 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:40.818614 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:40.818616 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:40.818781 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:40.819596 (+ 815us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:40.819627 (+ 31us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:40.820306 (+ 679us) client_negotiation.cc:769] Sending connection context
0811 05:03:40.820637 (+ 331us) client_negotiation.cc:240] Negotiation successful
0811 05:03:40.821223 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":167,"threads_started":1}
I20260811 05:03:40.824169 27622 heartbeater.cc:347] Connected to a master server at 127.22.49.254:44931
I20260811 05:03:40.824489 27622 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:40.825062 27622 heartbeater.cc:511] Master 127.22.49.254:44931 requested a full tablet report, sending...
I20260811 05:03:40.826414 27255 ts_manager.cc:194] Registered new tserver with Master: cb42a3929e9143e38ae38dfe157a51a6 (127.22.49.194:35201)
I20260811 05:03:40.827395 27255 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:50377
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:03:40.843921 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44931
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:40.977154 27627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:40.977535 27627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:40.977624 27627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:40.982199 27627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:40.982337 27627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:40.982448 27627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:03:40.988750 27627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:40.990034 27627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:40.991164 27627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:41.003144 27636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:41.003144 27638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:41.003222 27634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:41.003515 27627 server_base.cc:1034] running on GCE node
I20260811 05:03:41.004467 27627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:41.005282 27627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:41.006618 27627 hybrid_clock.cc:648] HybridClock initialized: now 1786424621006532 us; error 89 us; skew 500 ppm
Aug 11 05:03:41 dist-test-slave-w206 krb5kdc[27205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424621, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:41.011735 27627 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:03:41.013257 27627 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:41.013475 27627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:41.013820 27627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:41.016986 27627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "37039d2915374f89891728377a42375c"
format_stamp: "Formatted at 2026-08-11 05:03:41 on dist-test-slave-w206"
server_key: "2447976f1105bba2252111e36050b5d7"
server_key_iv: "6fc0f54442a450131c2cf9caaa3b858a"
server_key_version: "encryptionkey@0"
I20260811 05:03:41.018157 27627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "37039d2915374f89891728377a42375c"
format_stamp: "Formatted at 2026-08-11 05:03:41 on dist-test-slave-w206"
server_key: "2447976f1105bba2252111e36050b5d7"
server_key_iv: "6fc0f54442a450131c2cf9caaa3b858a"
server_key_version: "encryptionkey@0"
I20260811 05:03:41.023197 27627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 05:03:41.026842 27645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:41.028966 27627 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:03:41.029217 27627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "37039d2915374f89891728377a42375c"
format_stamp: "Formatted at 2026-08-11 05:03:41 on dist-test-slave-w206"
server_key: "2447976f1105bba2252111e36050b5d7"
server_key_iv: "6fc0f54442a450131c2cf9caaa3b858a"
server_key_version: "encryptionkey@0"
I20260811 05:03:41.029412 27627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:41.059989 27627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:41.065083 27627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:41.065308 27627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:41.065968 27627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:41.067294 27627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:41.067368 27627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:41.067420 27627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:41.067438 27627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:41.079131 27627 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:39307
I20260811 05:03:41.079151 27771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:39307 every 8 connection(s)
I20260811 05:03:41.079852 27627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:03:41.084705 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 27627
I20260811 05:03:41.085001 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:03:41.085662 22727 external_mini_cluster.cc:1428] Setting key 0e6dbd453b2f91880f0b3bc94a7a9ffd
Aug 11 05:03:41 dist-test-slave-w206 krb5kdc[27205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424621, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:41.099840 27299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.082397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:52591 (local address 127.22.49.254:44931)
0811 05:03:41.082623 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:41.082628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:41.083520 (+ 892us) server_negotiation.cc:407] Connection header received
0811 05:03:41.085336 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:41.085342 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:41.085416 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:41.085534 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:41.087079 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.087657 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.089064 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.089320 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.089466 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:41.093994 (+ 4528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:41.094000 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:41.094002 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:41.094051 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:41.096626 (+ 2575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:41.097510 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:41.097514 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:41.097515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:41.097628 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:41.098100 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:41.098110 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:41.098112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:41.098338 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:41.098476 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:41.099440 (+ 964us) server_negotiation.cc:299] Negotiation successful
0811 05:03:41.099659 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 05:03:41.101090 27774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.082692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:44931 (local address 127.22.49.195:52591)
0811 05:03:41.083336 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:41.083390 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:41.084799 (+ 1409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:41.085773 (+ 974us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:41.085787 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:41.086276 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:41.086870 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:41.086886 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.087829 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.087832 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:41.088890 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:41.088904 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.089527 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.089531 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:41.089761 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:41.090750 (+ 989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:41.090772 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:41.093554 (+ 2782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:41.096929 (+ 3375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:41.096938 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:41.096958 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:41.097345 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:41.097747 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:41.097750 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:41.097752 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:41.097972 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:41.098476 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:41.098486 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:41.098813 (+ 327us) client_negotiation.cc:769] Sending connection context
0811 05:03:41.099323 (+ 510us) client_negotiation.cc:240] Negotiation successful
0811 05:03:41.099757 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":252,"threads_started":1}
I20260811 05:03:41.102711 27772 heartbeater.cc:347] Connected to a master server at 127.22.49.254:44931
I20260811 05:03:41.103114 27772 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:41.103679 27772 heartbeater.cc:511] Master 127.22.49.254:44931 requested a full tablet report, sending...
I20260811 05:03:41.105160 27255 ts_manager.cc:194] Registered new tserver with Master: 37039d2915374f89891728377a42375c (127.22.49.195:39307)
I20260811 05:03:41.105788 27255 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:52591
I20260811 05:03:41.114279 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:03:41.128504 27299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.118487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54718 (local address 127.22.49.254:44931)
0811 05:03:41.118664 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:41.118669 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:41.118689 (+ 20us) server_negotiation.cc:407] Connection header received
0811 05:03:41.118749 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:41.118752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:41.118806 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:41.118915 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:41.119783 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.120472 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.121410 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.121652 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.121779 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:41.123879 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:41.123884 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:41.123886 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:41.123923 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:41.125702 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:41.126309 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:41.126313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:41.126317 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:41.126429 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:41.126749 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:41.126752 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:41.126754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:41.127316 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:41.127629 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:41.128134 (+ 505us) server_negotiation.cc:299] Negotiation successful
0811 05:03:41.128305 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 05:03:41.132846 27255 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54718:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:03:41.137537 27255 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:41.160784 27788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.153966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37004 (local address 127.22.49.195:39307)
0811 05:03:41.154635 (+ 669us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:41.154653 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:41.154681 (+ 28us) server_negotiation.cc:407] Connection header received
0811 05:03:41.154789 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:41.154795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:41.155112 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:41.155302 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:41.156124 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.157477 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.159237 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.159889 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.160077 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:41.160261 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:41.160478 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 05:03:41.160594 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":289,"threads_started":1}
I20260811 05:03:41.160779 27784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.148923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:35201 (local address 127.0.0.1:37966)
0811 05:03:41.153837 (+ 4914us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:41.153939 (+ 102us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:41.154142 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:41.155526 (+ 1384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:41.155534 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:41.155571 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:41.155981 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:41.155988 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.157682 (+ 1694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.157686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:41.158821 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:41.158834 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.160179 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.160183 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:41.160295 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:41.160325 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 05:03:41.160379 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 05:03:41.160588 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4644,"mutex_wait_us":216,"spinlock_wait_cycles":16640,"thread_start_us":141,"threads_started":1}
I20260811 05:03:41.161171 27787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.153151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:39307 (local address 127.0.0.1:37004)
0811 05:03:41.153838 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:41.153939 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:41.154142 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:41.155526 (+ 1384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:41.155534 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:41.155569 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:41.155971 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:41.155981 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.157660 (+ 1679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.157664 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:41.159065 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:41.159078 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.160084 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.160088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:41.160224 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:41.160269 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 05:03:41.160436 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 05:03:41.161054 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"mutex_wait_us":144,"spinlock_wait_cycles":46208,"thread_start_us":197,"threads_started":1}
I20260811 05:03:41.161432 27785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.150485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37966 (local address 127.22.49.194:35201)
0811 05:03:41.155010 (+ 4525us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:41.155027 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:41.155053 (+ 26us) server_negotiation.cc:407] Connection header received
0811 05:03:41.155132 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:41.155138 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:41.155325 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:41.156121 (+ 796us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:41.156312 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.157495 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.159016 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.160014 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.160550 (+ 536us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:41.160707 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:41.160762 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 05:03:41.161252 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4361,"thread_start_us":237,"threads_started":1}
I20260811 05:03:41.162283 27786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.153173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:39839 (local address 127.0.0.1:40920)
0811 05:03:41.154437 (+ 1264us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:41.154453 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:41.154548 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:41.156743 (+ 2195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:41.156746 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:41.156768 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:41.156909 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:41.156916 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.159167 (+ 2251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.159171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:41.160369 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:41.160380 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.161818 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.161822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:41.161942 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:41.161967 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 05:03:41.162055 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 05:03:41.162133 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1190,"thread_start_us":205,"threads_started":1}
I20260811 05:03:41.162755 27789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.154692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40920 (local address 127.22.49.193:39839)
0811 05:03:41.156227 (+ 1535us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:41.156233 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:41.156259 (+ 26us) server_negotiation.cc:407] Connection header received
0811 05:03:41.156339 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:41.156344 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:41.156592 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:41.156766 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:41.157048 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.157977 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.160522 (+ 2545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.161445 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.161577 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:41.161740 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:41.162491 (+ 751us) server_negotiation.cc:299] Negotiation successful
0811 05:03:41.162614 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1413,"thread_start_us":84,"threads_started":1}
I20260811 05:03:41.164840 27698 tablet_service.cc:1467] Processing CreateTablet for tablet a1da56b765874d37813b8e7e37abf24a (DEFAULT_TABLE table=test-table [id=0a7c1945defa404f9a686c2b836502da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:41.164896 27545 tablet_service.cc:1467] Processing CreateTablet for tablet a1da56b765874d37813b8e7e37abf24a (DEFAULT_TABLE table=test-table [id=0a7c1945defa404f9a686c2b836502da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:41.166244 27545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1da56b765874d37813b8e7e37abf24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:41.166270 27698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1da56b765874d37813b8e7e37abf24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:41.165820 27388 tablet_service.cc:1467] Processing CreateTablet for tablet a1da56b765874d37813b8e7e37abf24a (DEFAULT_TABLE table=test-table [id=0a7c1945defa404f9a686c2b836502da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:41.167059 27388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1da56b765874d37813b8e7e37abf24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:41.174610 27791 tablet_bootstrap.cc:492] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c: Bootstrap starting.
I20260811 05:03:41.176131 27792 tablet_bootstrap.cc:492] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6: Bootstrap starting.
I20260811 05:03:41.177358 27791 tablet_bootstrap.cc:654] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:41.178040 27794 tablet_bootstrap.cc:492] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873: Bootstrap starting.
I20260811 05:03:41.178529 27792 tablet_bootstrap.cc:654] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:41.178933 27791 log.cc:824] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:41.179878 27792 log.cc:824] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:41.180941 27794 tablet_bootstrap.cc:654] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:41.181633 27791 tablet_bootstrap.cc:492] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c: No bootstrap required, opened a new log
I20260811 05:03:41.181758 27794 log.cc:824] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:41.181879 27791 ts_tablet_manager.cc:1397] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 05:03:41.182255 27792 tablet_bootstrap.cc:492] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6: No bootstrap required, opened a new log
I20260811 05:03:41.182461 27792 ts_tablet_manager.cc:1397] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260811 05:03:41.183949 27794 tablet_bootstrap.cc:492] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873: No bootstrap required, opened a new log
I20260811 05:03:41.184208 27794 ts_tablet_manager.cc:1397] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 05:03:41.186681 27792 raft_consensus.cc:348] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb42a3929e9143e38ae38dfe157a51a6" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35201 } } peers { permanent_uuid: "42b9d39bc6de411eab0eb7e48934b873" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39839 } } peers { permanent_uuid: "37039d2915374f89891728377a42375c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39307 } }
I20260811 05:03:41.187109 27792 raft_consensus.cc:374] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:41.187177 27792 raft_consensus.cc:729] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb42a3929e9143e38ae38dfe157a51a6, State: Initialized, Role: FOLLOWER
I20260811 05:03:41.187736 27792 consensus_queue.cc:260] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb42a3929e9143e38ae38dfe157a51a6" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35201 } } peers { permanent_uuid: "42b9d39bc6de411eab0eb7e48934b873" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39839 } } peers { permanent_uuid: "37039d2915374f89891728377a42375c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39307 } }
I20260811 05:03:41.187973 27791 raft_consensus.cc:348] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb42a3929e9143e38ae38dfe157a51a6" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35201 } } peers { permanent_uuid: "42b9d39bc6de411eab0eb7e48934b873" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39839 } } peers { permanent_uuid: "37039d2915374f89891728377a42375c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39307 } }
I20260811 05:03:41.188295 27791 raft_consensus.cc:374] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:41.188037 27794 raft_consensus.cc:348] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb42a3929e9143e38ae38dfe157a51a6" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35201 } } peers { permanent_uuid: "42b9d39bc6de411eab0eb7e48934b873" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39839 } } peers { permanent_uuid: "37039d2915374f89891728377a42375c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39307 } }
I20260811 05:03:41.188373 27791 raft_consensus.cc:729] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37039d2915374f89891728377a42375c, State: Initialized, Role: FOLLOWER
I20260811 05:03:41.188382 27794 raft_consensus.cc:374] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:41.188448 27794 raft_consensus.cc:729] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b9d39bc6de411eab0eb7e48934b873, State: Initialized, Role: FOLLOWER
I20260811 05:03:41.188956 27622 heartbeater.cc:503] Master 127.22.49.254:44931 was elected leader, sending a full tablet report...
I20260811 05:03:41.189095 27791 consensus_queue.cc:260] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb42a3929e9143e38ae38dfe157a51a6" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35201 } } peers { permanent_uuid: "42b9d39bc6de411eab0eb7e48934b873" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39839 } } peers { permanent_uuid: "37039d2915374f89891728377a42375c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39307 } }
I20260811 05:03:41.189451 27792 ts_tablet_manager.cc:1428] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260811 05:03:41.189940 27794 consensus_queue.cc:260] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb42a3929e9143e38ae38dfe157a51a6" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35201 } } peers { permanent_uuid: "42b9d39bc6de411eab0eb7e48934b873" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39839 } } peers { permanent_uuid: "37039d2915374f89891728377a42375c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39307 } }
I20260811 05:03:41.191496 27469 heartbeater.cc:503] Master 127.22.49.254:44931 was elected leader, sending a full tablet report...
I20260811 05:03:41.191514 27794 ts_tablet_manager.cc:1428] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260811 05:03:41.191951 27791 ts_tablet_manager.cc:1428] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260811 05:03:41.192402 27772 heartbeater.cc:503] Master 127.22.49.254:44931 was elected leader, sending a full tablet report...
I20260811 05:03:41.213194 27798 raft_consensus.cc:482] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:41.213536 27798 raft_consensus.cc:504] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb42a3929e9143e38ae38dfe157a51a6" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35201 } } peers { permanent_uuid: "42b9d39bc6de411eab0eb7e48934b873" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39839 } } peers { permanent_uuid: "37039d2915374f89891728377a42375c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39307 } }
I20260811 05:03:41.214944 27798 leader_election.cc:288] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42b9d39bc6de411eab0eb7e48934b873 (127.22.49.193:39839), 37039d2915374f89891728377a42375c (127.22.49.195:39307)
I20260811 05:03:41.220016 27788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.215572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:35331 (local address 127.22.49.195:39307)
0811 05:03:41.215709 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:41.215714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:41.216027 (+ 313us) server_negotiation.cc:407] Connection header received
0811 05:03:41.216141 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:41.216143 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:41.216187 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:41.216295 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:41.216623 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.217135 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.218604 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.219338 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.219481 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:41.219541 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:41.219784 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 05:03:41.219870 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:03:41.219982 27624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.215241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:39839 (local address 127.22.49.194:35369)
0811 05:03:41.215480 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:41.215500 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:41.215612 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:41.215958 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:41.215964 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:41.215987 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:41.216161 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:41.216167 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.217142 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.217147 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:41.218467 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:41.218480 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.219379 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.219387 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:41.219537 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:41.219576 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 05:03:41.219662 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 05:03:41.219775 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":108}
I20260811 05:03:41.219982 27789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.215408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:35369 (local address 127.22.49.193:39839)
0811 05:03:41.215606 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:41.215613 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:41.215637 (+ 24us) server_negotiation.cc:407] Connection header received
0811 05:03:41.215733 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:41.215740 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:41.215819 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:41.215900 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:41.216323 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.217004 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.218660 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.219217 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.219330 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:41.219378 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:41.219714 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 05:03:41.219813 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 05:03:41.220003 27801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.215386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:39307 (local address 127.22.49.194:35331)
0811 05:03:41.215902 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:41.215918 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:41.216035 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:41.216355 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:41.216357 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:41.216373 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:41.216475 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:41.216480 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.217259 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.217266 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:41.218443 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:41.218476 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.219519 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.219522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:41.219609 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:41.219628 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 05:03:41.219741 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 05:03:41.219815 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"mutex_wait_us":7,"spinlock_wait_cycles":31104,"thread_start_us":170,"threads_started":1}
I20260811 05:03:41.220852 27414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1da56b765874d37813b8e7e37abf24a" candidate_uuid: "cb42a3929e9143e38ae38dfe157a51a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b9d39bc6de411eab0eb7e48934b873" is_pre_election: true
I20260811 05:03:41.220901 27721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1da56b765874d37813b8e7e37abf24a" candidate_uuid: "cb42a3929e9143e38ae38dfe157a51a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37039d2915374f89891728377a42375c" is_pre_election: true
I20260811 05:03:41.221256 27721 raft_consensus.cc:2454] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb42a3929e9143e38ae38dfe157a51a6 in term 0.
I20260811 05:03:41.221266 27414 raft_consensus.cc:2454] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb42a3929e9143e38ae38dfe157a51a6 in term 0.
I20260811 05:03:41.221953 27494 leader_election.cc:302] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 37039d2915374f89891728377a42375c, 42b9d39bc6de411eab0eb7e48934b873, cb42a3929e9143e38ae38dfe157a51a6; no voters:
I20260811 05:03:41.222458 27798 raft_consensus.cc:2781] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:41.222558 27798 raft_consensus.cc:482] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:41.222594 27798 raft_consensus.cc:3037] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:41.224182 27798 raft_consensus.cc:504] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb42a3929e9143e38ae38dfe157a51a6" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35201 } } peers { permanent_uuid: "42b9d39bc6de411eab0eb7e48934b873" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39839 } } peers { permanent_uuid: "37039d2915374f89891728377a42375c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39307 } }
I20260811 05:03:41.224677 27798 leader_election.cc:288] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [CANDIDATE]: Term 1 election: Requested vote from peers 42b9d39bc6de411eab0eb7e48934b873 (127.22.49.193:39839), 37039d2915374f89891728377a42375c (127.22.49.195:39307)
I20260811 05:03:41.225221 27721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1da56b765874d37813b8e7e37abf24a" candidate_uuid: "cb42a3929e9143e38ae38dfe157a51a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37039d2915374f89891728377a42375c"
I20260811 05:03:41.225258 27414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1da56b765874d37813b8e7e37abf24a" candidate_uuid: "cb42a3929e9143e38ae38dfe157a51a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b9d39bc6de411eab0eb7e48934b873"
I20260811 05:03:41.225378 27721 raft_consensus.cc:3037] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:41.225412 27414 raft_consensus.cc:3037] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:41.226601 27721 raft_consensus.cc:2454] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb42a3929e9143e38ae38dfe157a51a6 in term 1.
I20260811 05:03:41.226892 27414 raft_consensus.cc:2454] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb42a3929e9143e38ae38dfe157a51a6 in term 1.
I20260811 05:03:41.227077 27494 leader_election.cc:302] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37039d2915374f89891728377a42375c, cb42a3929e9143e38ae38dfe157a51a6; no voters:
I20260811 05:03:41.227308 27798 raft_consensus.cc:2781] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:41.227629 27798 raft_consensus.cc:686] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [term 1 LEADER]: Becoming Leader. State: Replica: cb42a3929e9143e38ae38dfe157a51a6, State: Running, Role: LEADER
I20260811 05:03:41.228039 27798 consensus_queue.cc:237] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb42a3929e9143e38ae38dfe157a51a6" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35201 } } peers { permanent_uuid: "42b9d39bc6de411eab0eb7e48934b873" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39839 } } peers { permanent_uuid: "37039d2915374f89891728377a42375c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39307 } }
I20260811 05:03:41.231907 27253 catalog_manager.cc:5495] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb42a3929e9143e38ae38dfe157a51a6 (127.22.49.194). New cstate: current_term: 1 leader_uuid: "cb42a3929e9143e38ae38dfe157a51a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb42a3929e9143e38ae38dfe157a51a6" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42b9d39bc6de411eab0eb7e48934b873" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37039d2915374f89891728377a42375c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39307 } health_report { overall_health: UNKNOWN } } }
I20260811 05:03:41.265801 27785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.260671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37980 (local address 127.22.49.194:35201)
0811 05:03:41.260863 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:41.260866 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:41.260940 (+ 74us) server_negotiation.cc:407] Connection header received
0811 05:03:41.261185 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:41.261189 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:41.261258 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:41.261451 (+ 193us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:41.261758 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.262367 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.263642 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:41.263875 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:41.263974 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:41.264744 (+ 770us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:41.265282 (+ 538us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:41.265397 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:41.265568 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 05:03:41.265647 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 05:03:41.273816 27721 raft_consensus.cc:1261] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c [term 1 FOLLOWER]: Refusing update from remote peer cb42a3929e9143e38ae38dfe157a51a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:41.273820 27414 raft_consensus.cc:1261] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873 [term 1 FOLLOWER]: Refusing update from remote peer cb42a3929e9143e38ae38dfe157a51a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:41.274868 27803 consensus_queue.cc:1035] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b9d39bc6de411eab0eb7e48934b873" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:41.275199 27798 consensus_queue.cc:1035] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37039d2915374f89891728377a42375c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:41.283619 27806 mvcc.cc:205] Tried to move back new op lower bound from 7317195248728440832 to 7317195248552873984. Current Snapshot: MvccSnapshot[applied={T|T < 7317195248728440832}]
I20260811 05:03:41.285607 27807 mvcc.cc:205] Tried to move back new op lower bound from 7317195248728440832 to 7317195248552873984. Current Snapshot: MvccSnapshot[applied={T|T < 7317195248728440832}]
I20260811 05:03:41.285862 27808 mvcc.cc:205] Tried to move back new op lower bound from 7317195248728440832 to 7317195248552873984. Current Snapshot: MvccSnapshot[applied={T|T < 7317195248728440832}]
I20260811 05:03:41.294502 27253 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54718:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:41.294731 27253 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54718:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:41.298137 27253 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b6416b17b1af474ca9066f6ec73d73ad: Sending DeleteTablet for 3 replicas of tablet a1da56b765874d37813b8e7e37abf24a
I20260811 05:03:41.299453 27545 tablet_service.cc:1514] Processing DeleteTablet for tablet a1da56b765874d37813b8e7e37abf24a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:41 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:37966
I20260811 05:03:41.299431 27388 tablet_service.cc:1514] Processing DeleteTablet for tablet a1da56b765874d37813b8e7e37abf24a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:41 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:40920
I20260811 05:03:41.300104 27816 tablet_replica.cc:330] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6: stopping tablet replica
I20260811 05:03:41.300164 27817 tablet_replica.cc:330] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873: stopping tablet replica
I20260811 05:03:41.300554 27816 raft_consensus.cc:2229] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:03:41.300554 27817 raft_consensus.cc:2229] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:41.300572 27698 tablet_service.cc:1514] Processing DeleteTablet for tablet a1da56b765874d37813b8e7e37abf24a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:41 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:37004
I20260811 05:03:41.300951 27817 raft_consensus.cc:2258] T a1da56b765874d37813b8e7e37abf24a P 42b9d39bc6de411eab0eb7e48934b873 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:41.301286 27816 raft_consensus.cc:2258] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:41.301435 27818 tablet_replica.cc:330] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c: stopping tablet replica
I20260811 05:03:41.301797 27818 raft_consensus.cc:2229] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:41.302130 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 27322
I20260811 05:03:41.302201 27818 raft_consensus.cc:2258] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:41.305135 27816 ts_tablet_manager.cc:1905] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:41.309489 27818 ts_tablet_manager.cc:1905] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:41.309804 27816 ts_tablet_manager.cc:1918] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:41.310060 27816 log.cc:1196] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/a1da56b765874d37813b8e7e37abf24a
I20260811 05:03:41.310580 27816 ts_tablet_manager.cc:1939] T a1da56b765874d37813b8e7e37abf24a P cb42a3929e9143e38ae38dfe157a51a6: Deleting consensus metadata
I20260811 05:03:41.312443 27238 catalog_manager.cc:4841] TS cb42a3929e9143e38ae38dfe157a51a6 (127.22.49.194:35201): tablet a1da56b765874d37813b8e7e37abf24a (table test-table [id=0a7c1945defa404f9a686c2b836502da]) successfully deleted
I20260811 05:03:41.312839 27818 ts_tablet_manager.cc:1918] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:41.312980 27818 log.cc:1196] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/a1da56b765874d37813b8e7e37abf24a
I20260811 05:03:41.313364 27818 ts_tablet_manager.cc:1939] T a1da56b765874d37813b8e7e37abf24a P 37039d2915374f89891728377a42375c: Deleting consensus metadata
I20260811 05:03:41.315122 27240 catalog_manager.cc:4841] TS 37039d2915374f89891728377a42375c (127.22.49.195:39307): tablet a1da56b765874d37813b8e7e37abf24a (table test-table [id=0a7c1945defa404f9a686c2b836502da]) successfully deleted
W20260811 05:03:41.315766 27237 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:39839 (error 108)
I20260811 05:03:41.316911 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 27474
I20260811 05:03:41.317137 27786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.316763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:39839 (local address 127.0.0.1:40930)
0811 05:03:41.316911 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:41.317008 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:39839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 05:03:41.320567 27237 catalog_manager.cc:4584] TS 42b9d39bc6de411eab0eb7e48934b873 (127.22.49.193:39839): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a1da56b765874d37813b8e7e37abf24a: Network error: Client connection negotiation failed: client connection to 127.22.49.193:39839: connect: Connection refused (error 111)
I20260811 05:03:41.325976 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 27627
I20260811 05:03:41.334676 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 27220
2026-08-11T05:03:41Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2640 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T05:03:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:41Z Disabled control of system clock
I20260811 05:03:41.373270 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:43719
--webserver_interface=127.22.49.254
--webserver_port=0
--builtin_ntp_servers=127.22.49.212:35757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:43719
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 05:03:41.502931 27824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:41.503304 27824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:41.503347 27824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:41.508224 27824 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:41.508343 27824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:41.508361 27824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:41.508383 27824 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:41.508399 27824 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:03:41.514108 27824 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:35757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:43719
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:43719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:41.515457 27824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:41.517366 27824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:03:41.528580 27824 server_base.cc:1034] running on GCE node
W20260811 05:03:41.528517 27830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:41.528513 27831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:41.528513 27833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:41.529706 27824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:41.531255 27824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:41.532529 27824 hybrid_clock.cc:648] HybridClock initialized: now 1786424621532496 us; error 57 us; skew 500 ppm
I20260811 05:03:41.535650 27824 webserver.cc:460] Webserver started at http://127.22.49.254:45005/ using document root <none> and password file <none>
I20260811 05:03:41.536441 27824 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:41.536527 27824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:41.536804 27824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:41.539383 27824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "f674a9a3712546d3aea6af8cb2e6274a"
format_stamp: "Formatted at 2026-08-11 05:03:41 on dist-test-slave-w206"
server_key: "25c07525dc3b8029c44c258c9038b01d"
server_key_iv: "105d8a9084f99eacdc041cba657eb8b6"
server_key_version: "encryptionkey@0"
I20260811 05:03:41.540096 27824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "f674a9a3712546d3aea6af8cb2e6274a"
format_stamp: "Formatted at 2026-08-11 05:03:41 on dist-test-slave-w206"
server_key: "25c07525dc3b8029c44c258c9038b01d"
server_key_iv: "105d8a9084f99eacdc041cba657eb8b6"
server_key_version: "encryptionkey@0"
I20260811 05:03:41.545112 27824 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 05:03:41.548306 27839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:41.549909 27824 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:03:41.550148 27824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "f674a9a3712546d3aea6af8cb2e6274a"
format_stamp: "Formatted at 2026-08-11 05:03:41 on dist-test-slave-w206"
server_key: "25c07525dc3b8029c44c258c9038b01d"
server_key_iv: "105d8a9084f99eacdc041cba657eb8b6"
server_key_version: "encryptionkey@0"
I20260811 05:03:41.550356 27824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:41.556573 27824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:41.557406 27824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:41.557651 27824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:41.566435 27824 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:43719
I20260811 05:03:41.566473 27896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:43719 every 8 connection(s)
I20260811 05:03:41.567667 27824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:41.571549 27897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:41.573021 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 27824
I20260811 05:03:41.573191 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:41.573505 22727 external_mini_cluster.cc:1428] Setting key 0fea5f0ff611aa03ee660fa6ba129a37
I20260811 05:03:41.578656 27897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a: Bootstrap starting.
I20260811 05:03:41.580024 27900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.575194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38384 (local address 127.22.49.254:43719)
0811 05:03:41.576045 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:41.576063 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:41.576104 (+ 41us) server_negotiation.cc:407] Connection header received
0811 05:03:41.576831 (+ 727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:41.576861 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:41.577257 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:41.577722 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:41.578548 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:41.578553 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:41.578566 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:41.578577 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:41.578635 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:41.578652 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:41.578827 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:41.578907 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 05:03:41.579227 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":184,"threads_started":1}
I20260811 05:03:41.581568 27897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:41.582441 27897 log.cc:824] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:41.584652 27897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a: No bootstrap required, opened a new log
I20260811 05:03:41.588739 27897 raft_consensus.cc:348] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f674a9a3712546d3aea6af8cb2e6274a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43719 } }
I20260811 05:03:41.589088 27897 raft_consensus.cc:374] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:41.589197 27897 raft_consensus.cc:729] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f674a9a3712546d3aea6af8cb2e6274a, State: Initialized, Role: FOLLOWER
I20260811 05:03:41.589721 27897 consensus_queue.cc:260] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f674a9a3712546d3aea6af8cb2e6274a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43719 } }
I20260811 05:03:41.589880 27897 raft_consensus.cc:388] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:41.589998 27897 raft_consensus.cc:482] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:41.590124 27897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:41.591367 27897 raft_consensus.cc:504] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f674a9a3712546d3aea6af8cb2e6274a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43719 } }
I20260811 05:03:41.591781 27897 leader_election.cc:302] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f674a9a3712546d3aea6af8cb2e6274a; no voters:
I20260811 05:03:41.592163 27897 leader_election.cc:288] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:41.592410 27902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:41.592741 27902 raft_consensus.cc:686] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [term 1 LEADER]: Becoming Leader. State: Replica: f674a9a3712546d3aea6af8cb2e6274a, State: Running, Role: LEADER
I20260811 05:03:41.593103 27902 consensus_queue.cc:237] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f674a9a3712546d3aea6af8cb2e6274a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43719 } }
I20260811 05:03:41.593657 27897 sys_catalog.cc:564] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:41.595084 27906 sys_catalog.cc:455] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f674a9a3712546d3aea6af8cb2e6274a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f674a9a3712546d3aea6af8cb2e6274a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43719 } } }
I20260811 05:03:41.595158 27907 sys_catalog.cc:455] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f674a9a3712546d3aea6af8cb2e6274a. Latest consensus state: current_term: 1 leader_uuid: "f674a9a3712546d3aea6af8cb2e6274a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f674a9a3712546d3aea6af8cb2e6274a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43719 } } }
I20260811 05:03:41.595255 27906 sys_catalog.cc:458] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:41.595280 27907 sys_catalog.cc:458] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a [sys.catalog]: This master's current role is: LEADER
W20260811 05:03:41.599129 27922 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:03:41.599255 27922 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:03:41.599337 27915 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:41.600243 27915 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:41.606415 27915 catalog_manager.cc:1347] Generated new cluster ID: a3e207a962234bc9ba743d5b028fe5a7
I20260811 05:03:41.606541 27915 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:41.617059 27915 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:41.617475 27915 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:41.623344 27915 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a: Generated new TSK 0
I20260811 05:03:41.624210 27915 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:03:41.627650 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43719
--builtin_ntp_servers=127.22.49.212:35757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 05:03:41.754503 27927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:41.754930 27927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:41.755050 27927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:41.759864 27927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:41.759984 27927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:41.760051 27927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:03:41.766283 27927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:35757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:41.767678 27927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:41.769297 27927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:41.780778 27932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:41.780830 27927 server_base.cc:1034] running on GCE node
W20260811 05:03:41.780802 27937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:41.781390 27934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:41.781973 27927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:41.782814 27927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:41.784046 27927 hybrid_clock.cc:648] HybridClock initialized: now 1786424621784031 us; error 38 us; skew 500 ppm
I20260811 05:03:41.786485 27927 webserver.cc:460] Webserver started at http://127.22.49.193:35731/ using document root <none> and password file <none>
I20260811 05:03:41.787287 27927 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:41.787402 27927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:41.787698 27927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:41.790231 27927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "a331e3ddcc164580ae2eaf454eef1ce9"
format_stamp: "Formatted at 2026-08-11 05:03:41 on dist-test-slave-w206"
server_key: "25614f98c0cd6383fc76d40cbcc69aec"
server_key_iv: "4af6570c92574d50c01a3a4e0f9d5c93"
server_key_version: "encryptionkey@0"
I20260811 05:03:41.791316 27927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "a331e3ddcc164580ae2eaf454eef1ce9"
format_stamp: "Formatted at 2026-08-11 05:03:41 on dist-test-slave-w206"
server_key: "25614f98c0cd6383fc76d40cbcc69aec"
server_key_iv: "4af6570c92574d50c01a3a4e0f9d5c93"
server_key_version: "encryptionkey@0"
I20260811 05:03:41.795876 27927 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 05:03:41.799191 27943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:41.800822 27927 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 05:03:41.801033 27927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "a331e3ddcc164580ae2eaf454eef1ce9"
format_stamp: "Formatted at 2026-08-11 05:03:41 on dist-test-slave-w206"
server_key: "25614f98c0cd6383fc76d40cbcc69aec"
server_key_iv: "4af6570c92574d50c01a3a4e0f9d5c93"
server_key_version: "encryptionkey@0"
I20260811 05:03:41.801201 27927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:41.806716 27927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:41.807597 27927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:41.807853 27927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:41.808535 27927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:41.809772 27927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:41.809842 27927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:41.809901 27927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:41.809923 27927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:41.820220 27927 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:39833
I20260811 05:03:41.820326 28070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:39833 every 8 connection(s)
I20260811 05:03:41.821333 27927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:03:41.826702 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 27927
I20260811 05:03:41.826894 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:03:41.827217 22727 external_mini_cluster.cc:1428] Setting key 0f4b65b2eae749a9d65cfe2696ecb0c6
I20260811 05:03:41.830518 27900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.823664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:55637 (local address 127.22.49.254:43719)
0811 05:03:41.823845 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:41.823849 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:41.825017 (+ 1168us) server_negotiation.cc:407] Connection header received
0811 05:03:41.826687 (+ 1670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:41.826694 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:41.826749 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:41.826868 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:41.829824 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:41.829831 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:41.829837 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:41.829862 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:41.829893 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:41.829909 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:41.830003 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:41.830305 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 05:03:41.830371 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 05:03:41.832422 28073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:41.824028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43719 (local address 127.22.49.193:55637)
0811 05:03:41.824835 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:41.824882 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:41.826302 (+ 1420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:41.827244 (+ 942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:41.827254 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:41.828348 (+ 1094us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:41.829305 (+ 957us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:03:41.829309 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:41.829391 (+ 82us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:03:41.829551 (+ 160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:41.830096 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:41.830107 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:41.830115 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 05:03:41.830833 (+ 718us) client_negotiation.cc:240] Negotiation successful
0811 05:03:41.831208 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":137,"threads_started":1}
I20260811 05:03:41.832930 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43719
--builtin_ntp_servers=127.22.49.212:35757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 05:03:41.834353 28071 heartbeater.cc:347] Connected to a master server at 127.22.49.254:43719
I20260811 05:03:41.834651 28071 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:41.835292 28071 heartbeater.cc:511] Master 127.22.49.254:43719 requested a full tablet report, sending...
I20260811 05:03:41.837134 27858 ts_manager.cc:194] Registered new tserver with Master: a331e3ddcc164580ae2eaf454eef1ce9 (127.22.49.193:39833)
W20260811 05:03:41.965583 28074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:41.965965 28074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:41.966051 28074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:41.970579 28074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:41.970702 28074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:41.970815 28074 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:03:41.976218 28074 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:35757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:41.977511 28074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:41.979174 28074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:41.993110 28082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:41.993094 28080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:41.993172 28079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:41.994208 28074 server_base.cc:1034] running on GCE node
I20260811 05:03:41.994957 28074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:41.995939 28074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:41.997162 28074 hybrid_clock.cc:648] HybridClock initialized: now 1786424621997139 us; error 48 us; skew 500 ppm
I20260811 05:03:42.000108 28074 webserver.cc:460] Webserver started at http://127.22.49.194:35229/ using document root <none> and password file <none>
I20260811 05:03:42.000873 28074 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:42.000962 28074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:42.001233 28074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:42.003854 28074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "46f30ed2e0624192ae38a17ce2ed08e5"
format_stamp: "Formatted at 2026-08-11 05:03:41 on dist-test-slave-w206"
server_key: "6cfdf5551e5a2ffa30f3546973362752"
server_key_iv: "a51ce5c4121ca4ad36de171256523691"
server_key_version: "encryptionkey@0"
I20260811 05:03:42.004580 28074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "46f30ed2e0624192ae38a17ce2ed08e5"
format_stamp: "Formatted at 2026-08-11 05:03:41 on dist-test-slave-w206"
server_key: "6cfdf5551e5a2ffa30f3546973362752"
server_key_iv: "a51ce5c4121ca4ad36de171256523691"
server_key_version: "encryptionkey@0"
I20260811 05:03:42.009326 28074 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:03:42.012640 28088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:42.014465 28074 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 05:03:42.014696 28074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "46f30ed2e0624192ae38a17ce2ed08e5"
format_stamp: "Formatted at 2026-08-11 05:03:41 on dist-test-slave-w206"
server_key: "6cfdf5551e5a2ffa30f3546973362752"
server_key_iv: "a51ce5c4121ca4ad36de171256523691"
server_key_version: "encryptionkey@0"
I20260811 05:03:42.014866 28074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:42.021991 28074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:42.023090 28074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:42.023463 28074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:42.024266 28074 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:42.025418 28074 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:42.025504 28074 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:42.025588 28074 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:42.025643 28074 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:42.038331 28074 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:40823
I20260811 05:03:42.038352 28210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:40823 every 8 connection(s)
I20260811 05:03:42.039498 28074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:03:42.043913 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 28074
I20260811 05:03:42.044076 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:03:42.044438 22727 external_mini_cluster.cc:1428] Setting key 46d7df7f347005d01ad97e43591c0d78
I20260811 05:03:42.046643 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43719
--builtin_ntp_servers=127.22.49.212:35757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 05:03:42.049821 27900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.042253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:43595 (local address 127.22.49.254:43719)
0811 05:03:42.042458 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:42.042463 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:42.044330 (+ 1867us) server_negotiation.cc:407] Connection header received
0811 05:03:42.047105 (+ 2775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:42.047111 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:42.047167 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:42.047270 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:42.049176 (+ 1906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:42.049182 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:42.049187 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:42.049208 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:42.049240 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:42.049253 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:42.049372 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:42.049573 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 05:03:42.049631 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 05:03:42.051100 28213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.042681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43719 (local address 127.22.49.194:43595)
0811 05:03:42.044063 (+ 1382us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:42.044150 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:42.046449 (+ 2299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:42.047638 (+ 1189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:42.047653 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:42.047834 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:42.048708 (+ 874us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:03:42.048711 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:42.048794 (+ 83us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:03:42.048937 (+ 143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:42.049376 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:42.049388 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:42.049398 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 05:03:42.049609 (+ 211us) client_negotiation.cc:240] Negotiation successful
0811 05:03:42.049898 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":237,"threads_started":1}
I20260811 05:03:42.052698 28211 heartbeater.cc:347] Connected to a master server at 127.22.49.254:43719
I20260811 05:03:42.053045 28211 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:42.053584 28211 heartbeater.cc:511] Master 127.22.49.254:43719 requested a full tablet report, sending...
I20260811 05:03:42.054961 27858 ts_manager.cc:194] Registered new tserver with Master: 46f30ed2e0624192ae38a17ce2ed08e5 (127.22.49.194:40823)
W20260811 05:03:42.177528 28214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:42.177882 28214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:42.177968 28214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:42.182437 28214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:42.182566 28214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:42.182668 28214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:03:42.188720 28214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:35757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:42.190021 28214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:42.191702 28214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:42.203716 28219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:42.203718 28221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:42.203805 28214 server_base.cc:1034] running on GCE node
W20260811 05:03:42.203716 28223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:42.204566 28214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:42.205307 28214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:42.206509 28214 hybrid_clock.cc:648] HybridClock initialized: now 1786424622206482 us; error 42 us; skew 500 ppm
I20260811 05:03:42.208719 28214 webserver.cc:460] Webserver started at http://127.22.49.195:46065/ using document root <none> and password file <none>
I20260811 05:03:42.209364 28214 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:42.209448 28214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:42.209674 28214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:42.212157 28214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "b140b260439746afb495d1ea9b8ec6b6"
format_stamp: "Formatted at 2026-08-11 05:03:42 on dist-test-slave-w206"
server_key: "ed3ca66551edb9654739f90dc369b141"
server_key_iv: "398318f3567ba3a8c77581004c903f3e"
server_key_version: "encryptionkey@0"
I20260811 05:03:42.212812 28214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "b140b260439746afb495d1ea9b8ec6b6"
format_stamp: "Formatted at 2026-08-11 05:03:42 on dist-test-slave-w206"
server_key: "ed3ca66551edb9654739f90dc369b141"
server_key_iv: "398318f3567ba3a8c77581004c903f3e"
server_key_version: "encryptionkey@0"
I20260811 05:03:42.217015 28214 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:03:42.219888 28229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:42.221501 28214 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 05:03:42.221637 28214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "b140b260439746afb495d1ea9b8ec6b6"
format_stamp: "Formatted at 2026-08-11 05:03:42 on dist-test-slave-w206"
server_key: "ed3ca66551edb9654739f90dc369b141"
server_key_iv: "398318f3567ba3a8c77581004c903f3e"
server_key_version: "encryptionkey@0"
I20260811 05:03:42.221766 28214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:42.227104 28214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:42.228124 28214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:42.228366 28214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:42.229044 28214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:42.230115 28214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:42.230190 28214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:42.230259 28214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:42.230290 28214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:42.242127 28214 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:40583
I20260811 05:03:42.242180 28359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:40583 every 8 connection(s)
I20260811 05:03:42.243194 28214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:03:42.247500 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 28214
I20260811 05:03:42.247642 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:03:42.247910 22727 external_mini_cluster.cc:1428] Setting key c7168c4f7bc7934f6d13d327e9439b6b
I20260811 05:03:42.249890 27900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.245213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:50351 (local address 127.22.49.254:43719)
0811 05:03:42.245371 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:42.245376 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:42.246517 (+ 1141us) server_negotiation.cc:407] Connection header received
0811 05:03:42.248037 (+ 1520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:42.248041 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:42.248091 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:42.248199 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:42.249395 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:42.249398 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:42.249401 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:42.249414 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:42.249437 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:42.249447 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:42.249545 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:42.249701 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 05:03:42.249750 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 05:03:42.250835 28362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.245689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43719 (local address 127.22.49.195:50351)
0811 05:03:42.246355 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:42.246397 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:42.247795 (+ 1398us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:42.248380 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:42.248387 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:42.248480 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:42.249121 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:03:42.249122 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:42.249165 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:03:42.249238 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:42.249545 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:42.249557 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:42.249565 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 05:03:42.249752 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 05:03:42.250027 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":125,"threads_started":1}
I20260811 05:03:42.251999 28360 heartbeater.cc:347] Connected to a master server at 127.22.49.254:43719
I20260811 05:03:42.252235 28360 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:42.252646 28360 heartbeater.cc:511] Master 127.22.49.254:43719 requested a full tablet report, sending...
I20260811 05:03:42.253686 27858 ts_manager.cc:194] Registered new tserver with Master: b140b260439746afb495d1ea9b8ec6b6 (127.22.49.195:40583)
I20260811 05:03:42.261845 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:03:42.265674 27900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.263987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38398 (local address 127.22.49.254:43719)
0811 05:03:42.264154 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:42.264158 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:42.264277 (+ 119us) server_negotiation.cc:407] Connection header received
0811 05:03:42.264419 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:42.264421 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:42.264466 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:42.264543 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:42.265278 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:42.265281 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:42.265283 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:42.265295 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:42.265317 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:42.265325 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:42.265424 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:42.265521 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 05:03:42.265558 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 05:03:42.268718 27858 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38398:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:03:42.271888 27858 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:42.284264 28373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.280922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:39833 (local address 127.0.0.1:56740)
0811 05:03:42.281291 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:42.281346 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:42.281477 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:42.282620 (+ 1143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:42.282628 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:42.282708 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:42.283372 (+ 664us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:03:42.283373 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:42.283396 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:03:42.283475 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:42.283881 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:42.283892 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:42.283898 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 05:03:42.284025 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 05:03:42.284103 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":86,"threads_started":1}
I20260811 05:03:42.284288 28375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.281066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56740 (local address 127.22.49.193:39833)
0811 05:03:42.282022 (+ 956us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:42.282034 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:42.282061 (+ 27us) server_negotiation.cc:407] Connection header received
0811 05:03:42.282121 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:42.282127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:42.282406 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:42.282599 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:42.283642 (+ 1043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:42.283650 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:42.283665 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:42.283680 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:42.283730 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:42.283774 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:42.283905 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:42.284038 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 05:03:42.284127 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":825,"thread_start_us":148,"threads_started":1}
I20260811 05:03:42.285367 28376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.281669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:40823 (local address 127.0.0.1:49642)
0811 05:03:42.282379 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:42.282392 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:42.282492 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:42.283419 (+ 927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:42.283423 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:42.283439 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:42.284670 (+ 1231us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:03:42.284671 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:42.284681 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:03:42.284704 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:42.285093 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:42.285099 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:42.285103 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:03:42.285184 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 05:03:42.285224 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"thread_start_us":86,"threads_started":1}
I20260811 05:03:42.285593 28378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.282218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48778 (local address 127.22.49.195:40583)
0811 05:03:42.282575 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:42.282587 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:42.282611 (+ 24us) server_negotiation.cc:407] Connection header received
0811 05:03:42.282660 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:42.282665 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:42.282827 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:42.283674 (+ 847us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:42.284292 (+ 618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:42.284299 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:42.284312 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:42.284328 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:42.284805 (+ 477us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:42.284850 (+ 45us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:42.285301 (+ 451us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:42.285349 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 05:03:42.285419 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":114,"threads_started":1}
I20260811 05:03:42.285858 28377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.281847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49642 (local address 127.22.49.194:40823)
0811 05:03:42.282245 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:42.282255 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:42.282586 (+ 331us) server_negotiation.cc:407] Connection header received
0811 05:03:42.282693 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:42.282699 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:42.282864 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:42.283026 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:42.284851 (+ 1825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:42.284857 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:42.284869 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:42.284886 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:42.284930 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:42.284961 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:42.285059 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:42.285215 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 05:03:42.285295 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":107,"threads_started":1}
I20260811 05:03:42.285876 28374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.281120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:40583 (local address 127.0.0.1:48778)
0811 05:03:42.281656 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:42.281672 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:42.281753 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:42.283360 (+ 1607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:42.283364 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:42.283381 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:42.284024 (+ 643us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:03:42.284026 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:42.284037 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:03:42.284065 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:42.285077 (+ 1012us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:42.285080 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:42.285085 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:03:42.285212 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 05:03:42.285235 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":97,"threads_started":1}
I20260811 05:03:42.287385 27996 tablet_service.cc:1467] Processing CreateTablet for tablet c3d55cc3b2ab471ba74eacdbf34a9324 (DEFAULT_TABLE table=test-table [id=442fe12a283e4506a032a1c1f5844cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:42.288676 27996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3d55cc3b2ab471ba74eacdbf34a9324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:42.288908 28141 tablet_service.cc:1467] Processing CreateTablet for tablet c3d55cc3b2ab471ba74eacdbf34a9324 (DEFAULT_TABLE table=test-table [id=442fe12a283e4506a032a1c1f5844cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:42.289377 28270 tablet_service.cc:1467] Processing CreateTablet for tablet c3d55cc3b2ab471ba74eacdbf34a9324 (DEFAULT_TABLE table=test-table [id=442fe12a283e4506a032a1c1f5844cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:42.289827 28141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3d55cc3b2ab471ba74eacdbf34a9324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:42.290369 28270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3d55cc3b2ab471ba74eacdbf34a9324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:42.296692 28379 tablet_bootstrap.cc:492] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5: Bootstrap starting.
I20260811 05:03:42.298071 28380 tablet_bootstrap.cc:492] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9: Bootstrap starting.
I20260811 05:03:42.299381 28381 tablet_bootstrap.cc:492] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6: Bootstrap starting.
I20260811 05:03:42.300248 28379 tablet_bootstrap.cc:654] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:42.300284 28380 tablet_bootstrap.cc:654] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:42.301076 28379 log.cc:824] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:42.301152 28380 log.cc:824] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:42.301836 28381 tablet_bootstrap.cc:654] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:42.302709 28381 log.cc:824] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:42.303917 28379 tablet_bootstrap.cc:492] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5: No bootstrap required, opened a new log
I20260811 05:03:42.304150 28379 ts_tablet_manager.cc:1397] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260811 05:03:42.304984 28380 tablet_bootstrap.cc:492] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9: No bootstrap required, opened a new log
I20260811 05:03:42.304983 28381 tablet_bootstrap.cc:492] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6: No bootstrap required, opened a new log
I20260811 05:03:42.305187 28380 ts_tablet_manager.cc:1397] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 05:03:42.305187 28381 ts_tablet_manager.cc:1397] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 05:03:42.308245 28379 raft_consensus.cc:348] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a331e3ddcc164580ae2eaf454eef1ce9" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39833 } } peers { permanent_uuid: "b140b260439746afb495d1ea9b8ec6b6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40583 } } peers { permanent_uuid: "46f30ed2e0624192ae38a17ce2ed08e5" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 40823 } }
I20260811 05:03:42.308550 28379 raft_consensus.cc:374] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:42.308606 28379 raft_consensus.cc:729] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f30ed2e0624192ae38a17ce2ed08e5, State: Initialized, Role: FOLLOWER
I20260811 05:03:42.309092 28379 consensus_queue.cc:260] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a331e3ddcc164580ae2eaf454eef1ce9" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39833 } } peers { permanent_uuid: "b140b260439746afb495d1ea9b8ec6b6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40583 } } peers { permanent_uuid: "46f30ed2e0624192ae38a17ce2ed08e5" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 40823 } }
I20260811 05:03:42.309890 28211 heartbeater.cc:503] Master 127.22.49.254:43719 was elected leader, sending a full tablet report...
I20260811 05:03:42.309965 28381 raft_consensus.cc:348] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a331e3ddcc164580ae2eaf454eef1ce9" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39833 } } peers { permanent_uuid: "b140b260439746afb495d1ea9b8ec6b6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40583 } } peers { permanent_uuid: "46f30ed2e0624192ae38a17ce2ed08e5" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 40823 } }
I20260811 05:03:42.310242 28381 raft_consensus.cc:374] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:42.310243 28379 ts_tablet_manager.cc:1428] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 05:03:42.310313 28381 raft_consensus.cc:729] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b140b260439746afb495d1ea9b8ec6b6, State: Initialized, Role: FOLLOWER
I20260811 05:03:42.310810 28381 consensus_queue.cc:260] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a331e3ddcc164580ae2eaf454eef1ce9" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39833 } } peers { permanent_uuid: "b140b260439746afb495d1ea9b8ec6b6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40583 } } peers { permanent_uuid: "46f30ed2e0624192ae38a17ce2ed08e5" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 40823 } }
I20260811 05:03:42.311594 28360 heartbeater.cc:503] Master 127.22.49.254:43719 was elected leader, sending a full tablet report...
I20260811 05:03:42.311707 28380 raft_consensus.cc:348] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a331e3ddcc164580ae2eaf454eef1ce9" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39833 } } peers { permanent_uuid: "b140b260439746afb495d1ea9b8ec6b6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40583 } } peers { permanent_uuid: "46f30ed2e0624192ae38a17ce2ed08e5" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 40823 } }
I20260811 05:03:42.312005 28380 raft_consensus.cc:374] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:42.312027 28381 ts_tablet_manager.cc:1428] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 05:03:42.312073 28380 raft_consensus.cc:729] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a331e3ddcc164580ae2eaf454eef1ce9, State: Initialized, Role: FOLLOWER
I20260811 05:03:42.312602 28380 consensus_queue.cc:260] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a331e3ddcc164580ae2eaf454eef1ce9" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39833 } } peers { permanent_uuid: "b140b260439746afb495d1ea9b8ec6b6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40583 } } peers { permanent_uuid: "46f30ed2e0624192ae38a17ce2ed08e5" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 40823 } }
I20260811 05:03:42.313763 28071 heartbeater.cc:503] Master 127.22.49.254:43719 was elected leader, sending a full tablet report...
I20260811 05:03:42.313794 28380 ts_tablet_manager.cc:1428] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
W20260811 05:03:42.322798 28072 tablet.cc:2369] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:03:42.328784 28388 raft_consensus.cc:482] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:42.329034 28388 raft_consensus.cc:504] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a331e3ddcc164580ae2eaf454eef1ce9" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39833 } } peers { permanent_uuid: "b140b260439746afb495d1ea9b8ec6b6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40583 } } peers { permanent_uuid: "46f30ed2e0624192ae38a17ce2ed08e5" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 40823 } }
I20260811 05:03:42.330410 28388 leader_election.cc:288] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b140b260439746afb495d1ea9b8ec6b6 (127.22.49.195:40583), 46f30ed2e0624192ae38a17ce2ed08e5 (127.22.49.194:40823)
I20260811 05:03:42.332564 28073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.330675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:40583 (local address 127.22.49.193:38581)
0811 05:03:42.330822 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:42.330851 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:42.330925 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:42.331295 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:42.331299 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:42.331316 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:42.331916 (+ 600us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:03:42.331918 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:42.331928 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:03:42.331952 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:42.332299 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:42.332303 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:42.332310 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 05:03:42.332393 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 05:03:42.332434 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 05:03:42.332607 28378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.330810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:38581 (local address 127.22.49.195:40583)
0811 05:03:42.330936 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:42.330942 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:42.330965 (+ 23us) server_negotiation.cc:407] Connection header received
0811 05:03:42.331039 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:42.331045 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:42.331089 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:42.331200 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:42.332064 (+ 864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:42.332072 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:42.332074 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:42.332086 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:42.332105 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:42.332114 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:42.332192 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:42.332412 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 05:03:42.332458 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 05:03:42.332841 28389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.330929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:40823 (local address 127.22.49.193:59191)
0811 05:03:42.331339 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:42.331351 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:42.331424 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:42.331659 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:42.331663 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:42.331677 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:42.332112 (+ 435us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:03:42.332113 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:42.332121 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:03:42.332139 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:42.332561 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:42.332564 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:42.332567 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 05:03:42.332656 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 05:03:42.332690 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":171,"threads_started":1}
I20260811 05:03:42.333134 28377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.331174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:59191 (local address 127.22.49.194:40823)
0811 05:03:42.331306 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:42.331310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:42.331428 (+ 118us) server_negotiation.cc:407] Connection header received
0811 05:03:42.331500 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:42.331505 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:42.331551 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:42.331612 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:42.332408 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:42.332412 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:42.332414 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:42.332427 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:42.332450 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:42.332460 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:42.332551 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:42.332963 (+ 412us) server_negotiation.cc:299] Negotiation successful
0811 05:03:42.333004 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:03:42.333225 28305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d55cc3b2ab471ba74eacdbf34a9324" candidate_uuid: "a331e3ddcc164580ae2eaf454eef1ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b140b260439746afb495d1ea9b8ec6b6" is_pre_election: true
I20260811 05:03:42.333557 28305 raft_consensus.cc:2454] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a331e3ddcc164580ae2eaf454eef1ce9 in term 0.
I20260811 05:03:42.333629 28163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d55cc3b2ab471ba74eacdbf34a9324" candidate_uuid: "a331e3ddcc164580ae2eaf454eef1ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f30ed2e0624192ae38a17ce2ed08e5" is_pre_election: true
I20260811 05:03:42.333932 28163 raft_consensus.cc:2454] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a331e3ddcc164580ae2eaf454eef1ce9 in term 0.
I20260811 05:03:42.334070 27945 leader_election.cc:302] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a331e3ddcc164580ae2eaf454eef1ce9, b140b260439746afb495d1ea9b8ec6b6; no voters:
I20260811 05:03:42.334376 28388 raft_consensus.cc:2781] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:42.334456 28388 raft_consensus.cc:482] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:42.334487 28388 raft_consensus.cc:3037] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:42.335662 28388 raft_consensus.cc:504] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a331e3ddcc164580ae2eaf454eef1ce9" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39833 } } peers { permanent_uuid: "b140b260439746afb495d1ea9b8ec6b6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40583 } } peers { permanent_uuid: "46f30ed2e0624192ae38a17ce2ed08e5" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 40823 } }
I20260811 05:03:42.336004 28388 leader_election.cc:288] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [CANDIDATE]: Term 1 election: Requested vote from peers b140b260439746afb495d1ea9b8ec6b6 (127.22.49.195:40583), 46f30ed2e0624192ae38a17ce2ed08e5 (127.22.49.194:40823)
I20260811 05:03:42.336479 28305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d55cc3b2ab471ba74eacdbf34a9324" candidate_uuid: "a331e3ddcc164580ae2eaf454eef1ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b140b260439746afb495d1ea9b8ec6b6"
I20260811 05:03:42.336467 28163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d55cc3b2ab471ba74eacdbf34a9324" candidate_uuid: "a331e3ddcc164580ae2eaf454eef1ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f30ed2e0624192ae38a17ce2ed08e5"
I20260811 05:03:42.336606 28305 raft_consensus.cc:3037] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:42.336606 28163 raft_consensus.cc:3037] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:42.337967 28305 raft_consensus.cc:2454] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a331e3ddcc164580ae2eaf454eef1ce9 in term 1.
I20260811 05:03:42.337967 28163 raft_consensus.cc:2454] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a331e3ddcc164580ae2eaf454eef1ce9 in term 1.
I20260811 05:03:42.338294 27945 leader_election.cc:302] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f30ed2e0624192ae38a17ce2ed08e5, a331e3ddcc164580ae2eaf454eef1ce9; no voters:
I20260811 05:03:42.338496 28388 raft_consensus.cc:2781] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:42.338747 28388 raft_consensus.cc:686] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [term 1 LEADER]: Becoming Leader. State: Replica: a331e3ddcc164580ae2eaf454eef1ce9, State: Running, Role: LEADER
I20260811 05:03:42.339156 28388 consensus_queue.cc:237] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a331e3ddcc164580ae2eaf454eef1ce9" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39833 } } peers { permanent_uuid: "b140b260439746afb495d1ea9b8ec6b6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40583 } } peers { permanent_uuid: "46f30ed2e0624192ae38a17ce2ed08e5" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 40823 } }
I20260811 05:03:42.342411 27856 catalog_manager.cc:5495] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a331e3ddcc164580ae2eaf454eef1ce9 (127.22.49.193). New cstate: current_term: 1 leader_uuid: "a331e3ddcc164580ae2eaf454eef1ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a331e3ddcc164580ae2eaf454eef1ce9" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b140b260439746afb495d1ea9b8ec6b6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f30ed2e0624192ae38a17ce2ed08e5" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 40823 } health_report { overall_health: UNKNOWN } } }
I20260811 05:03:42.367522 28375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.365760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56746 (local address 127.22.49.193:39833)
0811 05:03:42.365952 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:42.365955 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:42.365970 (+ 15us) server_negotiation.cc:407] Connection header received
0811 05:03:42.366055 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:42.366057 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:42.366128 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:42.366202 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:42.367084 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:42.367087 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:42.367090 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:42.367102 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:42.367122 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:42.367131 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:42.367212 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:42.367299 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 05:03:42.367337 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 05:03:42.373916 28305 raft_consensus.cc:1261] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6 [term 1 FOLLOWER]: Refusing update from remote peer a331e3ddcc164580ae2eaf454eef1ce9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:42.373916 28163 raft_consensus.cc:1261] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5 [term 1 FOLLOWER]: Refusing update from remote peer a331e3ddcc164580ae2eaf454eef1ce9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:42.374782 28388 consensus_queue.cc:1035] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b140b260439746afb495d1ea9b8ec6b6" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:42.375058 28390 consensus_queue.cc:1035] T c3d55cc3b2ab471ba74eacdbf34a9324 P a331e3ddcc164580ae2eaf454eef1ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f30ed2e0624192ae38a17ce2ed08e5" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:42.384087 28395 mvcc.cc:205] Tried to move back new op lower bound from 7317195253235650560 to 7317195253104070656. Current Snapshot: MvccSnapshot[applied={T|T < 7317195253235650560}]
I20260811 05:03:42.394431 27857 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:42.394651 27857 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:42.397469 27857 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f674a9a3712546d3aea6af8cb2e6274a: Sending DeleteTablet for 3 replicas of tablet c3d55cc3b2ab471ba74eacdbf34a9324
I20260811 05:03:42.398327 27996 tablet_service.cc:1514] Processing DeleteTablet for tablet c3d55cc3b2ab471ba74eacdbf34a9324 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:42 UTC) from {username='slave'} at 127.0.0.1:56740
I20260811 05:03:42.398708 28141 tablet_service.cc:1514] Processing DeleteTablet for tablet c3d55cc3b2ab471ba74eacdbf34a9324 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:42 UTC) from {username='slave'} at 127.0.0.1:49642
I20260811 05:03:42.398926 28270 tablet_service.cc:1514] Processing DeleteTablet for tablet c3d55cc3b2ab471ba74eacdbf34a9324 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:42 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 05:03:42.399296 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 27927
I20260811 05:03:42.401564 28406 tablet_replica.cc:330] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6: stopping tablet replica
I20260811 05:03:42.401865 28405 tablet_replica.cc:330] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5: stopping tablet replica
I20260811 05:03:42.401914 28406 raft_consensus.cc:2229] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:42.402132 28405 raft_consensus.cc:2229] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:42.402246 28406 raft_consensus.cc:2258] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:42.402388 28405 raft_consensus.cc:2258] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:42.404281 28405 ts_tablet_manager.cc:1905] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:42.404680 28406 ts_tablet_manager.cc:1905] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:42.407267 28405 ts_tablet_manager.cc:1918] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:42.407392 28405 log.cc:1196] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/c3d55cc3b2ab471ba74eacdbf34a9324
I20260811 05:03:42.407470 28406 ts_tablet_manager.cc:1918] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:42.407572 28406 log.cc:1196] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/c3d55cc3b2ab471ba74eacdbf34a9324
I20260811 05:03:42.407742 28405 ts_tablet_manager.cc:1939] T c3d55cc3b2ab471ba74eacdbf34a9324 P 46f30ed2e0624192ae38a17ce2ed08e5: Deleting consensus metadata
I20260811 05:03:42.407915 28406 ts_tablet_manager.cc:1939] T c3d55cc3b2ab471ba74eacdbf34a9324 P b140b260439746afb495d1ea9b8ec6b6: Deleting consensus metadata
I20260811 05:03:42.409248 27841 catalog_manager.cc:4841] TS 46f30ed2e0624192ae38a17ce2ed08e5 (127.22.49.194:40823): tablet c3d55cc3b2ab471ba74eacdbf34a9324 (table test-table [id=442fe12a283e4506a032a1c1f5844cd0]) successfully deleted
I20260811 05:03:42.409548 27841 catalog_manager.cc:4841] TS b140b260439746afb495d1ea9b8ec6b6 (127.22.49.195:40583): tablet c3d55cc3b2ab471ba74eacdbf34a9324 (table test-table [id=442fe12a283e4506a032a1c1f5844cd0]) successfully deleted
W20260811 05:03:42.414103 27842 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:39833 (error 108)
I20260811 05:03:42.414363 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 28074
I20260811 05:03:42.417918 28374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.417548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:39833 (local address 127.0.0.1:56756)
0811 05:03:42.417706 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:42.417797 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:39833: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 05:03:42.418133 27842 catalog_manager.cc:4584] TS a331e3ddcc164580ae2eaf454eef1ce9 (127.22.49.193:39833): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c3d55cc3b2ab471ba74eacdbf34a9324: Network error: Client connection negotiation failed: client connection to 127.22.49.193:39833: connect: Connection refused (error 111)
I20260811 05:03:42.423626 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 28214
I20260811 05:03:42.430960 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 27824
2026-08-11T05:03:42Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1095 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 05:03:42.457079 22727 mini_oidc.cc:152] Starting JWKS server
I20260811 05:03:42.459074 22727 webserver.cc:460] Webserver started at https://127.0.0.1:33945/ using document root <none> and password file <none>
I20260811 05:03:42.459291 22727 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 05:03:42.459630 22727 webserver.cc:460] Webserver started at http://127.0.0.1:38923/ using document root <none> and password file <none>
2026-08-11T05:03:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:42Z Disabled control of system clock
I20260811 05:03:42.471120 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:40635
--webserver_interface=127.22.49.254
--webserver_port=0
--builtin_ntp_servers=127.22.49.212:38287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:40635
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33945/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/testchainca.cert with env {}
W20260811 05:03:42.591982 28415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:42.592304 28415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:42.592347 28415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:42.596511 28415 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:42.596596 28415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:42.596611 28415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:42.596627 28415 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:42.596643 28415 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 05:03:42.596659 28415 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 05:03:42.596673 28415 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33945/jwks.json
I20260811 05:03:42.602574 28415 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:38287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:40635
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:40635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33945/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:42.603901 28415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:42.604931 28415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:42.614557 28421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:42.614827 28426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:42.614878 28415 server_base.cc:1034] running on GCE node
W20260811 05:03:42.614566 28422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:42.615885 28415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:42.617182 28415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:42.618389 28415 hybrid_clock.cc:648] HybridClock initialized: now 1786424622618362 us; error 45 us; skew 500 ppm
I20260811 05:03:42.620625 28415 webserver.cc:460] Webserver started at http://127.22.49.254:45455/ using document root <none> and password file <none>
I20260811 05:03:42.621270 28415 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:42.621371 28415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:42.621622 28415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:42.623868 28415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "c902e9a520b642bda83aea5945112b7f"
format_stamp: "Formatted at 2026-08-11 05:03:42 on dist-test-slave-w206"
server_key: "e78c4277e0ef2a7a8bb195f9cae34b8e"
server_key_iv: "348366cc72b213a8967bd3f0e4ee38df"
server_key_version: "encryptionkey@0"
I20260811 05:03:42.624506 28415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "c902e9a520b642bda83aea5945112b7f"
format_stamp: "Formatted at 2026-08-11 05:03:42 on dist-test-slave-w206"
server_key: "e78c4277e0ef2a7a8bb195f9cae34b8e"
server_key_iv: "348366cc72b213a8967bd3f0e4ee38df"
server_key_version: "encryptionkey@0"
I20260811 05:03:42.628788 28415 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:03:42.631635 28433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:42.633006 28415 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:03:42.633191 28415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "c902e9a520b642bda83aea5945112b7f"
format_stamp: "Formatted at 2026-08-11 05:03:42 on dist-test-slave-w206"
server_key: "e78c4277e0ef2a7a8bb195f9cae34b8e"
server_key_iv: "348366cc72b213a8967bd3f0e4ee38df"
server_key_version: "encryptionkey@0"
I20260811 05:03:42.633332 28415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:42.659682 28415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:42.660524 28415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:42.660737 28415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:42.668468 28492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:40635 every 8 connection(s)
I20260811 05:03:42.668495 28415 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:40635
I20260811 05:03:42.669957 28415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:42.674178 28493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:42.678946 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 28415
I20260811 05:03:42.679121 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:42.679472 22727 external_mini_cluster.cc:1428] Setting key cda6685dcac50050a19bbfd3e0c961a4
I20260811 05:03:42.681418 28493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f: Bootstrap starting.
I20260811 05:03:42.684448 28493 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:42.685444 28493 log.cc:824] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:42.687764 28493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f: No bootstrap required, opened a new log
I20260811 05:03:42.691170 28496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.681106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34180 (local address 127.22.49.254:40635)
0811 05:03:42.682013 (+ 907us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:42.682035 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:42.682079 (+ 44us) server_negotiation.cc:407] Connection header received
0811 05:03:42.683040 (+ 961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:42.683067 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:42.683590 (+ 523us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:42.683972 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:42.684476 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:42.686005 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:42.687150 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:42.687682 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:42.687884 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:42.688815 (+ 931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:42.688820 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:42.688834 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:42.689241 (+ 407us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:42.689315 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:42.689336 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:42.689464 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:42.689586 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 05:03:42.689867 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":199,"threads_started":1}
I20260811 05:03:42.691164 28493 raft_consensus.cc:348] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c902e9a520b642bda83aea5945112b7f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40635 } }
I20260811 05:03:42.691507 28493 raft_consensus.cc:374] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:42.691597 28493 raft_consensus.cc:729] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c902e9a520b642bda83aea5945112b7f, State: Initialized, Role: FOLLOWER
I20260811 05:03:42.692061 28493 consensus_queue.cc:260] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c902e9a520b642bda83aea5945112b7f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40635 } }
I20260811 05:03:42.692219 28493 raft_consensus.cc:388] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:42.692308 28493 raft_consensus.cc:482] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:42.692412 28493 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:42.693523 28493 raft_consensus.cc:504] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c902e9a520b642bda83aea5945112b7f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40635 } }
I20260811 05:03:42.693948 28493 leader_election.cc:302] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c902e9a520b642bda83aea5945112b7f; no voters:
I20260811 05:03:42.694320 28493 leader_election.cc:288] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:42.694478 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:03:42.694486 28498 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:42.694718 28498 raft_consensus.cc:686] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [term 1 LEADER]: Becoming Leader. State: Replica: c902e9a520b642bda83aea5945112b7f, State: Running, Role: LEADER
I20260811 05:03:42.695075 28498 consensus_queue.cc:237] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c902e9a520b642bda83aea5945112b7f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40635 } }
I20260811 05:03:42.695744 28493 sys_catalog.cc:564] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:42.697103 28501 sys_catalog.cc:455] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c902e9a520b642bda83aea5945112b7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c902e9a520b642bda83aea5945112b7f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40635 } } }
I20260811 05:03:42.697105 28500 sys_catalog.cc:455] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c902e9a520b642bda83aea5945112b7f. Latest consensus state: current_term: 1 leader_uuid: "c902e9a520b642bda83aea5945112b7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c902e9a520b642bda83aea5945112b7f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40635 } } }
I20260811 05:03:42.697214 28501 sys_catalog.cc:458] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:42.697237 28500 sys_catalog.cc:458] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f [sys.catalog]: This master's current role is: LEADER
W20260811 05:03:42.700865 28516 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:03:42.700954 28516 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:03:42.701079 28509 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:42.701980 28509 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:42.708313 28509 catalog_manager.cc:1347] Generated new cluster ID: e176398d425648e5a8e0149617fea6dc
I20260811 05:03:42.708416 28509 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:42.724707 28509 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:42.725798 28509 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:42.733337 28509 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c902e9a520b642bda83aea5945112b7f: Generated new TSK 0
I20260811 05:03:42.734133 28509 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 05:03:42.770763 28528 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 05:03:42.770942 28528 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 05:03:42.771550 28496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:42.745967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34192 (local address 127.22.49.254:40635)
0811 05:03:42.746124 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:42.746129 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:42.746415 (+ 286us) server_negotiation.cc:407] Connection header received
0811 05:03:42.746684 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:42.746688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:42.746754 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:42.746865 (+ 111us) server_negotiation.cc:226] Negotiated authn=JWT
0811 05:03:42.747163 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:42.747746 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:42.748671 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:42.748932 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:42.749050 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:42.749456 (+ 406us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 05:03:42.771011 (+ 21555us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33945/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 05:03:42.771372 (+ 361us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34192: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33945/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":59}
W20260811 05:03:42.771667 28496 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34192: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33945/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 05:03:42.772943 28527 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:03:42.745846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:40635 (local address 127.0.0.1:34192)
0811 05:03:42.746310 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:42.746323 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:42.746501 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:42.746880 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:42.746884 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:42.746893 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0811 05:03:42.747049 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:42.747056 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:42.747873 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:42.747877 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:42.748526 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:42.748534 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:42.749062 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:42.749066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:42.749167 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:42.749221 (+ 54us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 05:03:42.771302 (+ 22081us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33945/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 05:03:42.771596 (+ 294us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.49.254:40635: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33945/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":133,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.22.49.254:40635: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33945/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 05:03:42.773725 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 28415
2026-08-11T05:03:42Z chronyd exiting
I20260811 05:03:42.815706 22727 test_util.cc:175] -----------------------------------------------
I20260811 05:03:42.815807 22727 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786424592714304-22727-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (360 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 05:03:42.817085 22727 mini_oidc.cc:152] Starting JWKS server
I20260811 05:03:42.818028 22727 webserver.cc:460] Webserver started at https://127.0.0.1:41741/ using document root <none> and password file <none>
I20260811 05:03:42.818120 22727 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 05:03:42.818414 22727 webserver.cc:460] Webserver started at http://127.0.0.1:45421/ using document root <none> and password file <none>
2026-08-11T05:03:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:42Z Disabled control of system clock
I20260811 05:03:42.829540 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:34403
--webserver_interface=127.22.49.254
--webserver_port=0
--builtin_ntp_servers=127.22.49.212:45095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:34403
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41741/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/testchainca.cert with env {}
W20260811 05:03:42.954811 28534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:42.955242 28534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:42.955294 28534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:42.959758 28534 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:42.959841 28534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:42.959857 28534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:42.959877 28534 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:42.959892 28534 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 05:03:42.959915 28534 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 05:03:42.959929 28534 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41741/jwks.json
I20260811 05:03:42.966033 28534 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:45095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:34403
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:34403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41741/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:42.967330 28534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:42.968402 28534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:42.978035 28542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:42.978087 28540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:42.978035 28539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:42.978518 28534 server_base.cc:1034] running on GCE node
I20260811 05:03:42.979256 28534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:42.980576 28534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:42.981802 28534 hybrid_clock.cc:648] HybridClock initialized: now 1786424622981763 us; error 59 us; skew 500 ppm
I20260811 05:03:42.984303 28534 webserver.cc:460] Webserver started at http://127.22.49.254:34163/ using document root <none> and password file <none>
I20260811 05:03:42.985579 28534 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:42.985698 28534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:42.985986 28534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:42.988555 28534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "3e8d27dee0c0466ca4e0310f7aeba5b6"
format_stamp: "Formatted at 2026-08-11 05:03:42 on dist-test-slave-w206"
server_key: "482385be81b5ca44c96f505be91be0f9"
server_key_iv: "6ba76f600fea77735f528cde8861502f"
server_key_version: "encryptionkey@0"
I20260811 05:03:42.989202 28534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "3e8d27dee0c0466ca4e0310f7aeba5b6"
format_stamp: "Formatted at 2026-08-11 05:03:42 on dist-test-slave-w206"
server_key: "482385be81b5ca44c96f505be91be0f9"
server_key_iv: "6ba76f600fea77735f528cde8861502f"
server_key_version: "encryptionkey@0"
I20260811 05:03:42.993736 28534 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:03:42.996850 28549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:42.998327 28534 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:42.998517 28534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "3e8d27dee0c0466ca4e0310f7aeba5b6"
format_stamp: "Formatted at 2026-08-11 05:03:42 on dist-test-slave-w206"
server_key: "482385be81b5ca44c96f505be91be0f9"
server_key_iv: "6ba76f600fea77735f528cde8861502f"
server_key_version: "encryptionkey@0"
I20260811 05:03:42.998680 28534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:43.037062 28534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:43.037976 28534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:43.038215 28534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:43.046480 28534 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:34403
I20260811 05:03:43.046556 28606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:34403 every 8 connection(s)
I20260811 05:03:43.047883 28534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:43.051680 28607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:43.058192 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 28534
I20260811 05:03:43.058349 28607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6: Bootstrap starting.
I20260811 05:03:43.058422 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:43.058756 22727 external_mini_cluster.cc:1428] Setting key 6209af94ab9fe06ee3457a71c331cad3
I20260811 05:03:43.061652 28607 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:43.062552 28607 log.cc:824] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:43.065277 28607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6: No bootstrap required, opened a new log
I20260811 05:03:43.069945 28610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:43.060364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58648 (local address 127.22.49.254:34403)
0811 05:03:43.061145 (+ 781us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:43.061160 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:43.061200 (+ 40us) server_negotiation.cc:407] Connection header received
0811 05:03:43.062021 (+ 821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:43.062044 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:43.062517 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:43.062895 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:43.063471 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.064544 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.065960 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.066582 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.066728 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:43.067759 (+ 1031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:43.067766 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:43.067782 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:43.068306 (+ 524us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:43.068380 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:43.068405 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:43.068498 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:43.068683 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 05:03:43.069054 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":183,"threads_started":1}
I20260811 05:03:43.070140 28607 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8d27dee0c0466ca4e0310f7aeba5b6" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 34403 } }
I20260811 05:03:43.070492 28607 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:43.070577 28607 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8d27dee0c0466ca4e0310f7aeba5b6, State: Initialized, Role: FOLLOWER
I20260811 05:03:43.071362 28607 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8d27dee0c0466ca4e0310f7aeba5b6" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 34403 } }
I20260811 05:03:43.071585 28607 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:43.071660 28607 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:43.071812 28607 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:43.073081 28607 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8d27dee0c0466ca4e0310f7aeba5b6" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 34403 } }
I20260811 05:03:43.073527 28607 leader_election.cc:302] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e8d27dee0c0466ca4e0310f7aeba5b6; no voters:
I20260811 05:03:43.073941 28607 leader_election.cc:288] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:43.074019 28612 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:43.074038 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:03:43.074265 28612 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8d27dee0c0466ca4e0310f7aeba5b6, State: Running, Role: LEADER
I20260811 05:03:43.074649 28612 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8d27dee0c0466ca4e0310f7aeba5b6" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 34403 } }
I20260811 05:03:43.075555 28607 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:43.076503 28614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e8d27dee0c0466ca4e0310f7aeba5b6. Latest consensus state: current_term: 1 leader_uuid: "3e8d27dee0c0466ca4e0310f7aeba5b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8d27dee0c0466ca4e0310f7aeba5b6" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 34403 } } }
I20260811 05:03:43.076684 28614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:43.077072 28613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e8d27dee0c0466ca4e0310f7aeba5b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8d27dee0c0466ca4e0310f7aeba5b6" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 34403 } } }
I20260811 05:03:43.077193 28613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:43.078547 28624 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:43.081974 28624 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:43.089191 28624 catalog_manager.cc:1347] Generated new cluster ID: d13ae4bb0000492f8fa3686bf5d163bc
I20260811 05:03:43.089293 28624 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:43.102056 28624 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:43.103598 28624 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:43.117161 28624 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e8d27dee0c0466ca4e0310f7aeba5b6: Generated new TSK 0
I20260811 05:03:43.118213 28624 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 05:03:43.154093 28643 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 05:03:43.154235 28643 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 05:03:43.155033 28610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:43.134530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58662 (local address 127.22.49.254:34403)
0811 05:03:43.134855 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:43.134860 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:43.134900 (+ 40us) server_negotiation.cc:407] Connection header received
0811 05:03:43.135167 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:43.135171 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:43.135243 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:43.135397 (+ 154us) server_negotiation.cc:226] Negotiated authn=JWT
0811 05:03:43.135952 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.137047 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.138182 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.138568 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.138693 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:43.139246 (+ 553us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 05:03:43.154505 (+ 15259us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41741/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 05:03:43.154837 (+ 332us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58662: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41741/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":175}
W20260811 05:03:43.155119 28610 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58662: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41741/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 05:03:43.155603 28641 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:03:43.134339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:34403 (local address 127.0.0.1:58662)
0811 05:03:43.134801 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:43.134816 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:43.134945 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:43.135638 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:43.135642 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:43.135649 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0811 05:03:43.135806 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:43.135812 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.137231 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.137236 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:43.137999 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:43.138011 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.138785 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.138788 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:43.138898 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:43.138935 (+ 37us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 05:03:43.154770 (+ 15835us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41741/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 05:03:43.154960 (+ 190us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.49.254:34403: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41741/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":156,"threads_started":1}
I20260811 05:03:43.156224 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 28534
2026-08-11T05:03:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (385 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 05:03:43.202765 22727 mini_oidc.cc:152] Starting JWKS server
I20260811 05:03:43.203855 22727 webserver.cc:460] Webserver started at https://127.0.0.1:40625/ using document root <none> and password file <none>
I20260811 05:03:43.203956 22727 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 05:03:43.204193 22727 webserver.cc:460] Webserver started at http://127.0.0.1:33891/ using document root <none> and password file <none>
2026-08-11T05:03:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:43Z Disabled control of system clock
I20260811 05:03:43.217883 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:44061
--webserver_interface=127.22.49.254
--webserver_port=0
--builtin_ntp_servers=127.22.49.212:35043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:44061
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40625/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 05:03:43.347354 28650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:43.347687 28650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:43.347733 28650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:43.352342 28650 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:43.352439 28650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:43.352455 28650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:43.352473 28650 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:43.352490 28650 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 05:03:43.352507 28650 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 05:03:43.352521 28650 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40625/jwks.json
I20260811 05:03:43.357896 28650 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:35043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:44061
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:44061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40625/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:43.359148 28650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:43.360667 28650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:43.370204 28656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:43.370250 28658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:43.370297 28650 server_base.cc:1034] running on GCE node
W20260811 05:03:43.370250 28655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:43.371212 28650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:43.372445 28650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:43.373636 28650 hybrid_clock.cc:648] HybridClock initialized: now 1786424623373618 us; error 41 us; skew 500 ppm
I20260811 05:03:43.376142 28650 webserver.cc:460] Webserver started at http://127.22.49.254:42381/ using document root <none> and password file <none>
I20260811 05:03:43.376816 28650 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:43.376889 28650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:43.377131 28650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:43.379603 28650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "18db1435caf049c780236c36d6533cce"
format_stamp: "Formatted at 2026-08-11 05:03:43 on dist-test-slave-w206"
server_key: "358c10242f7384ad42c86ae74e0a4e11"
server_key_iv: "2a13b00b3992cd6aada2ff620587c470"
server_key_version: "encryptionkey@0"
I20260811 05:03:43.380295 28650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "18db1435caf049c780236c36d6533cce"
format_stamp: "Formatted at 2026-08-11 05:03:43 on dist-test-slave-w206"
server_key: "358c10242f7384ad42c86ae74e0a4e11"
server_key_iv: "2a13b00b3992cd6aada2ff620587c470"
server_key_version: "encryptionkey@0"
I20260811 05:03:43.384747 28650 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:03:43.388176 28664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:43.389954 28650 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 05:03:43.390125 28650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "18db1435caf049c780236c36d6533cce"
format_stamp: "Formatted at 2026-08-11 05:03:43 on dist-test-slave-w206"
server_key: "358c10242f7384ad42c86ae74e0a4e11"
server_key_iv: "2a13b00b3992cd6aada2ff620587c470"
server_key_version: "encryptionkey@0"
I20260811 05:03:43.390342 28650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:43.411522 28650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:43.412353 28650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:43.412598 28650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:43.420475 28650 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:44061
I20260811 05:03:43.420560 28720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:44061 every 8 connection(s)
I20260811 05:03:43.421649 28650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:43.425661 28721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:43.426740 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 28650
I20260811 05:03:43.426860 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:43.427219 22727 external_mini_cluster.cc:1428] Setting key 1fa63a0e0559ae8768e240cd6420643b
I20260811 05:03:43.433580 28721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce: Bootstrap starting.
I20260811 05:03:43.437034 28721 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:43.438097 28721 log.cc:824] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:43.438863 28724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:43.428816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40902 (local address 127.22.49.254:44061)
0811 05:03:43.429565 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:43.429583 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:43.429625 (+ 42us) server_negotiation.cc:407] Connection header received
0811 05:03:43.430345 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:43.430376 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:43.430862 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:43.431304 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:43.431978 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.433187 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.434607 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.435281 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.435461 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:43.436611 (+ 1150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:43.436617 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:43.436635 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:43.437160 (+ 525us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:43.437260 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:43.437287 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:43.437382 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:43.437600 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 05:03:43.437955 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":173,"threads_started":1}
I20260811 05:03:43.440681 28721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce: No bootstrap required, opened a new log
I20260811 05:03:43.442081 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:03:43.445628 28721 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18db1435caf049c780236c36d6533cce" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44061 } }
I20260811 05:03:43.445995 28721 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:43.446055 28721 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18db1435caf049c780236c36d6533cce, State: Initialized, Role: FOLLOWER
I20260811 05:03:43.446673 28721 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18db1435caf049c780236c36d6533cce" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44061 } }
I20260811 05:03:43.446913 28721 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:43.447039 28721 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:43.447163 28721 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:43.448589 28721 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18db1435caf049c780236c36d6533cce" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44061 } }
I20260811 05:03:43.449072 28721 leader_election.cc:302] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18db1435caf049c780236c36d6533cce; no voters:
I20260811 05:03:43.449540 28721 leader_election.cc:288] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:43.449677 28726 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:43.449960 28726 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [term 1 LEADER]: Becoming Leader. State: Replica: 18db1435caf049c780236c36d6533cce, State: Running, Role: LEADER
I20260811 05:03:43.450361 28726 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18db1435caf049c780236c36d6533cce" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44061 } }
I20260811 05:03:43.451103 28721 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:43.452493 28728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18db1435caf049c780236c36d6533cce. Latest consensus state: current_term: 1 leader_uuid: "18db1435caf049c780236c36d6533cce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18db1435caf049c780236c36d6533cce" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44061 } } }
I20260811 05:03:43.452661 28728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:43.453104 28736 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:43.453099 28727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18db1435caf049c780236c36d6533cce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18db1435caf049c780236c36d6533cce" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44061 } } }
I20260811 05:03:43.453267 28727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:43.457921 28736 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:43.466617 28736 catalog_manager.cc:1347] Generated new cluster ID: f544da4c50dd437dbc7f481d0d0e496b
I20260811 05:03:43.466784 28736 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:43.473685 28736 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:43.474756 28736 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:43.490724 28736 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18db1435caf049c780236c36d6533cce: Generated new TSK 0
I20260811 05:03:43.492599 28736 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:03:43.513985 28724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:43.505443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40904 (local address 127.22.49.254:44061)
0811 05:03:43.505616 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:43.505621 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:43.505798 (+ 177us) server_negotiation.cc:407] Connection header received
0811 05:03:43.505974 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:43.505978 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:43.506044 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:43.506201 (+ 157us) server_negotiation.cc:226] Negotiated authn=JWT
0811 05:03:43.506806 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.508178 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.509686 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.510074 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.510546 (+ 472us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:43.511069 (+ 523us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 05:03:43.513425 (+ 2356us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40625/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 05:03:43.513793 (+ 368us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40904: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40625/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 05:03:43.514086 28724 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40904: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40625/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 05:03:43.516081 28753 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:03:43.505304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:44061 (local address 127.0.0.1:40904)
0811 05:03:43.505695 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:43.505709 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:43.505828 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:43.506223 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:43.506226 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:43.506233 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0811 05:03:43.506352 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:43.506357 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.508615 (+ 2258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.508619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:43.509325 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:43.509337 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.510626 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.510630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:43.510732 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:43.510769 (+ 37us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 05:03:43.513731 (+ 2962us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40625/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 05:03:43.515855 (+ 2124us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.49.254:44061: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40625/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":1767,"thread_start_us":141,"threads_started":1}
I20260811 05:03:43.517048 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 28650
E20260811 05:03:43.526760 28754 webserver.cc:533] Webserver: sslize failed:
E20260811 05:03:43.526865 28754 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T05:03:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (358 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T05:03:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:43Z Disabled control of system clock
I20260811 05:03:43.573210 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:44075
--webserver_interface=127.22.49.254
--webserver_port=0
--builtin_ntp_servers=127.22.49.212:36937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:44075
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/testchainca.cert with env {}
W20260811 05:03:43.706096 28758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:43.706450 28758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:43.706496 28758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:43.711025 28758 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:43.711122 28758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:43.711139 28758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:43.711158 28758 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:43.711174 28758 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 05:03:43.711191 28758 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 05:03:43.711205 28758 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 05:03:43.717233 28758 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:44075
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:44075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:43.718449 28758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:43.719600 28758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:43.729771 28770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:43.729771 28767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:43.729804 28768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:43.730363 28758 server_base.cc:1034] running on GCE node
I20260811 05:03:43.731525 28758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:43.732982 28758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:43.734252 28758 hybrid_clock.cc:648] HybridClock initialized: now 1786424623734228 us; error 46 us; skew 500 ppm
I20260811 05:03:43.737042 28758 webserver.cc:460] Webserver started at http://127.22.49.254:38263/ using document root <none> and password file <none>
I20260811 05:03:43.737764 28758 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:43.737887 28758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:43.738152 28758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:43.740919 28758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "6c8a97a8722944408ca4918c728e5b70"
format_stamp: "Formatted at 2026-08-11 05:03:43 on dist-test-slave-w206"
server_key: "7a08f29b124a20dd7ae82506872dd609"
server_key_iv: "cbe599972682edc068ded658b35d279e"
server_key_version: "encryptionkey@0"
I20260811 05:03:43.741711 28758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "6c8a97a8722944408ca4918c728e5b70"
format_stamp: "Formatted at 2026-08-11 05:03:43 on dist-test-slave-w206"
server_key: "7a08f29b124a20dd7ae82506872dd609"
server_key_iv: "cbe599972682edc068ded658b35d279e"
server_key_version: "encryptionkey@0"
I20260811 05:03:43.746471 28758 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260811 05:03:43.749876 28779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:43.751564 28758 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 05:03:43.751766 28758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "6c8a97a8722944408ca4918c728e5b70"
format_stamp: "Formatted at 2026-08-11 05:03:43 on dist-test-slave-w206"
server_key: "7a08f29b124a20dd7ae82506872dd609"
server_key_iv: "cbe599972682edc068ded658b35d279e"
server_key_version: "encryptionkey@0"
I20260811 05:03:43.751927 28758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:43.766259 28758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:43.767200 28758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:43.767457 28758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:43.776481 28758 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:44075
I20260811 05:03:43.776831 28841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:44075 every 8 connection(s)
I20260811 05:03:43.777972 28758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:43.781452 28842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:43.782377 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 28758
I20260811 05:03:43.782521 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:43.782845 22727 external_mini_cluster.cc:1428] Setting key 5022d8b138600af750c20f2cad07fc23
I20260811 05:03:43.789254 28842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70: Bootstrap starting.
I20260811 05:03:43.792215 28842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:43.793565 28842 log.cc:824] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:43.794436 28845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:43.784469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43716 (local address 127.22.49.254:44075)
0811 05:03:43.785397 (+ 928us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:43.785440 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:43.785487 (+ 47us) server_negotiation.cc:407] Connection header received
0811 05:03:43.786200 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:43.786220 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:43.786725 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:43.787310 (+ 585us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:43.787969 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.789038 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.790313 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.790876 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.791135 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:43.792147 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:43.792153 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:43.792170 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:03:43.792699 (+ 529us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:43.792771 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:03:43.792797 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:43.792938 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:43.793070 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 05:03:43.793396 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":168,"threads_started":1}
I20260811 05:03:43.796283 28842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70: No bootstrap required, opened a new log
I20260811 05:03:43.798657 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:03:43.801501 28842 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c8a97a8722944408ca4918c728e5b70" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44075 } }
I20260811 05:03:43.801877 28842 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:43.801956 28842 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c8a97a8722944408ca4918c728e5b70, State: Initialized, Role: FOLLOWER
I20260811 05:03:43.802532 28842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c8a97a8722944408ca4918c728e5b70" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44075 } }
I20260811 05:03:43.802675 28842 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:43.802763 28842 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:43.802897 28842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:43.804122 28842 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c8a97a8722944408ca4918c728e5b70" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44075 } }
I20260811 05:03:43.804529 28842 leader_election.cc:302] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c8a97a8722944408ca4918c728e5b70; no voters:
I20260811 05:03:43.804934 28842 leader_election.cc:288] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:43.805294 28847 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:43.805795 28847 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [term 1 LEADER]: Becoming Leader. State: Replica: 6c8a97a8722944408ca4918c728e5b70, State: Running, Role: LEADER
I20260811 05:03:43.806221 28847 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c8a97a8722944408ca4918c728e5b70" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44075 } }
I20260811 05:03:43.806495 28842 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:43.808461 28849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c8a97a8722944408ca4918c728e5b70. Latest consensus state: current_term: 1 leader_uuid: "6c8a97a8722944408ca4918c728e5b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c8a97a8722944408ca4918c728e5b70" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44075 } } }
I20260811 05:03:43.808667 28849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:43.809010 28848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c8a97a8722944408ca4918c728e5b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c8a97a8722944408ca4918c728e5b70" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44075 } } }
I20260811 05:03:43.809510 28848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70 [sys.catalog]: This master's current role is: LEADER
W20260811 05:03:43.812268 28865 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:03:43.812382 28865 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:03:43.812534 28864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:43.813683 28864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:43.821548 28864 catalog_manager.cc:1347] Generated new cluster ID: e976efafbe014530a30bc69a769c1941
I20260811 05:03:43.821671 28864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:43.843743 28864 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:43.845227 28864 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:43.856738 28864 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c8a97a8722944408ca4918c728e5b70: Generated new TSK 0
I20260811 05:03:43.857599 28864 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:03:43.941660 28845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:43.879355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43720 (local address 127.22.49.254:44075)
0811 05:03:43.879547 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:43.879552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:43.879846 (+ 294us) server_negotiation.cc:407] Connection header received
0811 05:03:43.880038 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:43.880041 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:43.880107 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:43.880218 (+ 111us) server_negotiation.cc:226] Negotiated authn=JWT
0811 05:03:43.880768 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.881392 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.882855 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.883227 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.883336 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:43.883772 (+ 436us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 05:03:43.941191 (+ 57419us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 05:03:43.941520 (+ 329us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43720: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 05:03:43.941823 28845 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43720: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 05:03:43.941948 28874 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:03:43.879270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:44075 (local address 127.0.0.1:43720)
0811 05:03:43.879705 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:43.879724 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:43.879876 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:43.880246 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:43.880250 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:43.880258 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0811 05:03:43.880388 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:43.880395 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.881550 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.881555 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:43.882656 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:43.882671 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:43.883401 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:43.883406 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:43.883514 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:43.883553 (+ 39us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 05:03:43.941505 (+ 57952us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 05:03:43.941745 (+ 240us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.49.254:44075: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":199,"threads_started":1}
I20260811 05:03:43.942464 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 28758
2026-08-11T05:03:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (404 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (145 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (169 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:03:44 dist-test-slave-w206 krb5kdc[28887](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:03:44 dist-test-slave-w206 krb5kdc[28887](info): set up 2 sockets
Aug 11 05:03:44 dist-test-slave-w206 krb5kdc[28887](info): commencing operation
krb5kdc: starting...
W20260811 05:03:45.693346 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.413s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:03:45 dist-test-slave-w206 krb5kdc[28887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:03:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:03:45.910152 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:44563
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:45373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:44563
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:46.084779 28900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:46.085119 28900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:46.085165 28900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:46.089596 28900 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:46.089691 28900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:46.089712 28900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:46.089730 28900 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:46.089746 28900 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:03:46.096269 28900 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:45373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:44563
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:44563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:46.097543 28900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:46.098620 28900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:46.108639 28910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:46.108631 28907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:46.108765 28900 server_base.cc:1034] running on GCE node
W20260811 05:03:46.109071 28908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:46.109825 28900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:46.111286 28900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:46.112530 28900 hybrid_clock.cc:648] HybridClock initialized: now 1786424626112495 us; error 54 us; skew 500 ppm
Aug 11 05:03:46 dist-test-slave-w206 krb5kdc[28887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424626, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:46.121529 28900 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:03:46.122733 28900 webserver.cc:460] Webserver started at http://127.22.49.254:44255/ using document root <none> and password file <none>
I20260811 05:03:46.123494 28900 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:46.123605 28900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:46.123880 28900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:46.126437 28900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "6d8da2b05edd43a78aa60ef18136d437"
format_stamp: "Formatted at 2026-08-11 05:03:46 on dist-test-slave-w206"
server_key: "48299882fe40b4d439b787c9dc078090"
server_key_iv: "6253319734a543a6d62f04f041c74b64"
server_key_version: "encryptionkey@0"
I20260811 05:03:46.127256 28900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "6d8da2b05edd43a78aa60ef18136d437"
format_stamp: "Formatted at 2026-08-11 05:03:46 on dist-test-slave-w206"
server_key: "48299882fe40b4d439b787c9dc078090"
server_key_iv: "6253319734a543a6d62f04f041c74b64"
server_key_version: "encryptionkey@0"
I20260811 05:03:46.133798 28900 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 05:03:46.137612 28919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:46.141147 28900 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260811 05:03:46.141681 28900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "6d8da2b05edd43a78aa60ef18136d437"
format_stamp: "Formatted at 2026-08-11 05:03:46 on dist-test-slave-w206"
server_key: "48299882fe40b4d439b787c9dc078090"
server_key_iv: "6253319734a543a6d62f04f041c74b64"
server_key_version: "encryptionkey@0"
I20260811 05:03:46.141932 28900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:46.171916 28900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:46.178304 28900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:46.178565 28900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:46.187886 28900 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:44563
I20260811 05:03:46.187948 28977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:44563 every 8 connection(s)
I20260811 05:03:46.189314 28900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:46.194078 28978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:46.195228 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 28900
I20260811 05:03:46.195426 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:46.195772 22727 external_mini_cluster.cc:1428] Setting key 6203b2a8d46a9efe139dade3f62daaba
I20260811 05:03:46.202533 28978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437: Bootstrap starting.
I20260811 05:03:46.205933 28978 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437: Neither blocks nor log segments found. Creating new log.
Aug 11 05:03:46 dist-test-slave-w206 krb5kdc[28887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:46.206882 28978 log.cc:824] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:46.209543 28978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437: No bootstrap required, opened a new log
I20260811 05:03:46.214597 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:46.197526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54086 (local address 127.22.49.254:44563)
0811 05:03:46.198107 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:46.198124 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:46.198167 (+ 43us) server_negotiation.cc:407] Connection header received
0811 05:03:46.199087 (+ 920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:46.199112 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:46.199583 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:46.199937 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:46.201111 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:46.202277 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:46.203626 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:46.204208 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:46.204377 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:46.207829 (+ 3452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:46.207840 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:46.207863 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:46.207904 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:46.210019 (+ 2115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:46.210829 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:46.210844 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:46.210858 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:46.211327 (+ 469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:46.211777 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:46.211781 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:46.211783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:46.212461 (+ 678us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:46.212726 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:46.213076 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 05:03:46.213437 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":184,"threads_started":1}
I20260811 05:03:46.214885 28978 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8da2b05edd43a78aa60ef18136d437" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44563 } }
I20260811 05:03:46.215270 28978 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:46.215353 28978 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8da2b05edd43a78aa60ef18136d437, State: Initialized, Role: FOLLOWER
I20260811 05:03:46.215909 28978 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8da2b05edd43a78aa60ef18136d437" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44563 } }
I20260811 05:03:46.216094 28978 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:46.216171 28978 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:46.216298 28978 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:46.217734 28978 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8da2b05edd43a78aa60ef18136d437" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44563 } }
I20260811 05:03:46.218137 28978 leader_election.cc:302] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d8da2b05edd43a78aa60ef18136d437; no voters:
I20260811 05:03:46.218925 28978 leader_election.cc:288] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:46.219106 28985 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:46.219409 28985 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8da2b05edd43a78aa60ef18136d437, State: Running, Role: LEADER
I20260811 05:03:46.219785 28985 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8da2b05edd43a78aa60ef18136d437" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44563 } }
I20260811 05:03:46.220448 28978 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:46.221760 28987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d8da2b05edd43a78aa60ef18136d437. Latest consensus state: current_term: 1 leader_uuid: "6d8da2b05edd43a78aa60ef18136d437" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8da2b05edd43a78aa60ef18136d437" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44563 } } }
I20260811 05:03:46.221925 28987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:46.222155 28986 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d8da2b05edd43a78aa60ef18136d437" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8da2b05edd43a78aa60ef18136d437" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44563 } } }
I20260811 05:03:46.222332 28986 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:46.222370 28994 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:46.226320 28994 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:46.233320 28994 catalog_manager.cc:1347] Generated new cluster ID: 1275c2ace400425a9be44b11aa53abd3
I20260811 05:03:46.233469 28994 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:46.242213 28994 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:46.243351 28994 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:46.253561 28994 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6d8da2b05edd43a78aa60ef18136d437: Generated new TSK 0
I20260811 05:03:46.254390 28994 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:03:46.296347 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44563
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:45373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:46.419492 29006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:46.419859 29006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:46.419946 29006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:46.424618 29006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:46.424736 29006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:46.424841 29006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:03:46.431550 29006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:45373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:46.432783 29006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:46.433943 29006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:46.444877 29012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:46.444933 29006 server_base.cc:1034] running on GCE node
W20260811 05:03:46.444877 29014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:46.444967 29011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:46.445647 29006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:46.446420 29006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:46.447693 29006 hybrid_clock.cc:648] HybridClock initialized: now 1786424626447666 us; error 42 us; skew 500 ppm
Aug 11 05:03:46 dist-test-slave-w206 krb5kdc[28887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424626, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:46.451165 29006 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:03:46.452333 29006 webserver.cc:460] Webserver started at http://127.22.49.193:36973/ using document root <none> and password file <none>
I20260811 05:03:46.453015 29006 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:46.453089 29006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:46.453331 29006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:46.455755 29006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "f5f3b3aae14b43ba838c14fcf5b28a1c"
format_stamp: "Formatted at 2026-08-11 05:03:46 on dist-test-slave-w206"
server_key: "c8faf3478717848473ee34693c9a7e1b"
server_key_iv: "b9c73c6b798f6c3a0bc97379f052c6ef"
server_key_version: "encryptionkey@0"
I20260811 05:03:46.456554 29006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "f5f3b3aae14b43ba838c14fcf5b28a1c"
format_stamp: "Formatted at 2026-08-11 05:03:46 on dist-test-slave-w206"
server_key: "c8faf3478717848473ee34693c9a7e1b"
server_key_iv: "b9c73c6b798f6c3a0bc97379f052c6ef"
server_key_version: "encryptionkey@0"
I20260811 05:03:46.461393 29006 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 05:03:46.464419 29022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:46.466018 29006 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 05:03:46.466173 29006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "f5f3b3aae14b43ba838c14fcf5b28a1c"
format_stamp: "Formatted at 2026-08-11 05:03:46 on dist-test-slave-w206"
server_key: "c8faf3478717848473ee34693c9a7e1b"
server_key_iv: "b9c73c6b798f6c3a0bc97379f052c6ef"
server_key_version: "encryptionkey@0"
I20260811 05:03:46.466323 29006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:46.488837 29006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:46.492688 29006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:46.492885 29006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:46.493638 29006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:46.494621 29006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:46.494678 29006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:46.494724 29006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:46.494738 29006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:46.507182 29006 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:46863
I20260811 05:03:46.507210 29146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:46863 every 8 connection(s)
I20260811 05:03:46.508366 29006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:03:46.516340 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 29006
I20260811 05:03:46.516474 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:03:46.516795 22727 external_mini_cluster.cc:1428] Setting key e2d0d96dad3daeae59c41e4316b05431
Aug 11 05:03:46 dist-test-slave-w206 krb5kdc[28887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424626, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:46.527613 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:46.510620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:44715 (local address 127.22.49.254:44563)
0811 05:03:46.510771 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:46.510775 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:46.511912 (+ 1137us) server_negotiation.cc:407] Connection header received
0811 05:03:46.513648 (+ 1736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:46.513651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:46.513722 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:46.513841 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:46.515336 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:46.516028 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:46.517732 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:46.517994 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:46.518123 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:46.522129 (+ 4006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:46.522133 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:46.522135 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:46.522167 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:46.524436 (+ 2269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:46.525282 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:46.525289 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:46.525293 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:46.525420 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:46.525906 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:46.525913 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:46.525918 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:46.526231 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:46.526397 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:46.527206 (+ 809us) server_negotiation.cc:299] Negotiation successful
0811 05:03:46.527396 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 05:03:46.528527 29149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:46.511040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:44563 (local address 127.22.49.193:44715)
0811 05:03:46.511710 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:46.511764 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:46.513353 (+ 1589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:46.514053 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:46.514061 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:46.514534 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:46.515143 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:46.515161 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:46.516235 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:46.516238 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:46.517517 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:46.517535 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:46.518192 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:46.518197 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:46.518401 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:46.519521 (+ 1120us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:46.519553 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:46.521871 (+ 2318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:46.524675 (+ 2804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:46.524683 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:46.524703 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:46.525061 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:46.525574 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:46.525577 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:46.525578 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:46.525771 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:46.526381 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:46.526388 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:46.526720 (+ 332us) client_negotiation.cc:769] Sending connection context
0811 05:03:46.527115 (+ 395us) client_negotiation.cc:240] Negotiation successful
0811 05:03:46.527488 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":186,"threads_started":1}
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:03:46.530340 29147 heartbeater.cc:347] Connected to a master server at 127.22.49.254:44563
I20260811 05:03:46.530696 29147 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:46.531383 29147 heartbeater.cc:511] Master 127.22.49.254:44563 requested a full tablet report, sending...
I20260811 05:03:46.533609 28935 ts_manager.cc:194] Registered new tserver with Master: f5f3b3aae14b43ba838c14fcf5b28a1c (127.22.49.193:46863)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
I20260811 05:03:46.535352 28935 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:44715
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:03:46.556427 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44563
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:45373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:46.688607 29152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:46.689006 29152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:46.689097 29152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:46.693744 29152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:46.693923 29152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:46.694041 29152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:03:46.700997 29152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:45373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:46.702400 29152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:46.703732 29152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:46.715400 29159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:46.715442 29162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:46.715400 29160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:46.715729 29152 server_base.cc:1034] running on GCE node
I20260811 05:03:46.716279 29152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:46.716988 29152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:46.718220 29152 hybrid_clock.cc:648] HybridClock initialized: now 1786424626718199 us; error 37 us; skew 500 ppm
Aug 11 05:03:46 dist-test-slave-w206 krb5kdc[28887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424626, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:46.721665 29152 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:03:46.722929 29152 webserver.cc:460] Webserver started at http://127.22.49.194:44539/ using document root <none> and password file <none>
I20260811 05:03:46.723711 29152 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:46.723791 29152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:46.724056 29152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:46.726687 29152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "b3ea9d9064074103abbedd50fdbd04d8"
format_stamp: "Formatted at 2026-08-11 05:03:46 on dist-test-slave-w206"
server_key: "5116bcf1b5b9e521e58dcc604dc9d268"
server_key_iv: "3606909300458c9f411221389099215e"
server_key_version: "encryptionkey@0"
I20260811 05:03:46.727499 29152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "b3ea9d9064074103abbedd50fdbd04d8"
format_stamp: "Formatted at 2026-08-11 05:03:46 on dist-test-slave-w206"
server_key: "5116bcf1b5b9e521e58dcc604dc9d268"
server_key_iv: "3606909300458c9f411221389099215e"
server_key_version: "encryptionkey@0"
I20260811 05:03:46.732277 29152 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 05:03:46.735803 29170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:46.737685 29152 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:03:46.737912 29152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "b3ea9d9064074103abbedd50fdbd04d8"
format_stamp: "Formatted at 2026-08-11 05:03:46 on dist-test-slave-w206"
server_key: "5116bcf1b5b9e521e58dcc604dc9d268"
server_key_iv: "3606909300458c9f411221389099215e"
server_key_version: "encryptionkey@0"
I20260811 05:03:46.738075 29152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:46.770344 29152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:46.774358 29152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:46.774748 29152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:46.775537 29152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:46.776556 29152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:46.776635 29152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:46.776718 29152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:46.776765 29152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:46.786608 29152 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:44127
I20260811 05:03:46.786633 29308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:44127 every 8 connection(s)
I20260811 05:03:46.787730 29152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:03:46.796499 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 29152
I20260811 05:03:46.796729 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:03:46.797075 22727 external_mini_cluster.cc:1428] Setting key 7b3c96db9f93cf0bcfa7e64a67e3f842
Aug 11 05:03:46 dist-test-slave-w206 krb5kdc[28887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424626, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:46.804272 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:46.789917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:34049 (local address 127.22.49.254:44563)
0811 05:03:46.790085 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:46.790089 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:46.791227 (+ 1138us) server_negotiation.cc:407] Connection header received
0811 05:03:46.792786 (+ 1559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:46.792789 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:46.792868 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:46.792985 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:46.794348 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:46.794913 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:46.796215 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:46.796453 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:46.796573 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:46.799898 (+ 3325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:46.799905 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:46.799912 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:46.799950 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:46.801801 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:46.802461 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:46.802464 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:46.802465 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:46.802550 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:46.802945 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:46.802948 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:46.802950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:46.803230 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:46.803340 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:46.803950 (+ 610us) server_negotiation.cc:299] Negotiation successful
0811 05:03:46.804095 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 05:03:46.805317 29311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:46.790404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:44563 (local address 127.22.49.194:34049)
0811 05:03:46.790963 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:46.791108 (+ 145us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:46.792526 (+ 1418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:46.793192 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:46.793200 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:46.793632 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:46.794168 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:46.794182 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:46.795097 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:46.795101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:46.796051 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:46.796062 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:46.796627 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:46.796630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:46.796915 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:46.797615 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:46.797633 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:46.799649 (+ 2016us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:46.801962 (+ 2313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:46.801971 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:46.801998 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:46.802313 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:46.802661 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:46.802665 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:46.802669 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:46.802830 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:46.803363 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:46.803378 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:46.803669 (+ 291us) client_negotiation.cc:769] Sending connection context
0811 05:03:46.803881 (+ 212us) client_negotiation.cc:240] Negotiation successful
0811 05:03:46.804265 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":163,"threads_started":1}
I20260811 05:03:46.806793 29309 heartbeater.cc:347] Connected to a master server at 127.22.49.254:44563
I20260811 05:03:46.807169 29309 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:46.807945 29309 heartbeater.cc:511] Master 127.22.49.254:44563 requested a full tablet report, sending...
I20260811 05:03:46.809383 28935 ts_manager.cc:194] Registered new tserver with Master: b3ea9d9064074103abbedd50fdbd04d8 (127.22.49.194:44127)
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
I20260811 05:03:46.810073 28935 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:34049
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:03:46.836036 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44563
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:45373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:46.962502 29314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:46.962824 29314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:46.962872 29314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:46.967555 29314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:46.967653 29314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:46.967718 29314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:03:46.974063 29314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:45373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:46.975308 29314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:46.976404 29314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:46.988440 29320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:46.988546 29322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:46.988546 29319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:46.989610 29314 server_base.cc:1034] running on GCE node
I20260811 05:03:46.990171 29314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:46.991083 29314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:46.992305 29314 hybrid_clock.cc:648] HybridClock initialized: now 1786424626992273 us; error 49 us; skew 500 ppm
Aug 11 05:03:46 dist-test-slave-w206 krb5kdc[28887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424626, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:46.996445 29314 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:03:46.997730 29314 webserver.cc:460] Webserver started at http://127.22.49.195:43415/ using document root <none> and password file <none>
I20260811 05:03:46.998445 29314 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:46.998524 29314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:46.998792 29314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:47.001495 29314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "ee792f1ad7bc4f3785f87b47414e17d2"
format_stamp: "Formatted at 2026-08-11 05:03:46 on dist-test-slave-w206"
server_key: "7788c5782d10483bcee4fbf4fa621581"
server_key_iv: "6a78b682c7a3d78d213a82c70a50d069"
server_key_version: "encryptionkey@0"
I20260811 05:03:47.002265 29314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "ee792f1ad7bc4f3785f87b47414e17d2"
format_stamp: "Formatted at 2026-08-11 05:03:46 on dist-test-slave-w206"
server_key: "7788c5782d10483bcee4fbf4fa621581"
server_key_iv: "6a78b682c7a3d78d213a82c70a50d069"
server_key_version: "encryptionkey@0"
I20260811 05:03:47.007512 29314 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 05:03:47.011301 29331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:47.013051 29314 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:03:47.013290 29314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "ee792f1ad7bc4f3785f87b47414e17d2"
format_stamp: "Formatted at 2026-08-11 05:03:46 on dist-test-slave-w206"
server_key: "7788c5782d10483bcee4fbf4fa621581"
server_key_iv: "6a78b682c7a3d78d213a82c70a50d069"
server_key_version: "encryptionkey@0"
I20260811 05:03:47.013509 29314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:47.032255 29314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:47.037266 29314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:47.037568 29314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:47.038364 29314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:47.039883 29314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:47.040042 29314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 05:03:47.040161 29314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:47.040223 29314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:47.052188 29314 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:34187
I20260811 05:03:47.052587 29462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:34187 every 8 connection(s)
I20260811 05:03:47.053391 29314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:03:47.055557 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 29314
I20260811 05:03:47.055691 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:03:47.056090 22727 external_mini_cluster.cc:1428] Setting key 5da2ef52073a6211e4ced1ded0483fab
Aug 11 05:03:47 dist-test-slave-w206 krb5kdc[28887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424626, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:03:47.074271 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:47.056479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:33419 (local address 127.22.49.254:44563)
0811 05:03:47.056663 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:47.056668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:47.058227 (+ 1559us) server_negotiation.cc:407] Connection header received
0811 05:03:47.060128 (+ 1901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:47.060131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:47.060203 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:47.060294 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:47.061793 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:47.062438 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:47.063999 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:47.064263 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:47.064446 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:47.068093 (+ 3647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:47.068097 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:47.068099 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:47.068132 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:47.070743 (+ 2611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:47.072289 (+ 1546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:47.072295 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:47.072299 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:47.072456 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:47.072971 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:47.072974 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:47.072975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:47.073192 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:47.073290 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:47.073975 (+ 685us) server_negotiation.cc:299] Negotiation successful
0811 05:03:47.074123 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 05:03:47.075311 29465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:47.057204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:44563 (local address 127.22.49.195:33419)
0811 05:03:47.058053 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:47.058111 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:47.059810 (+ 1699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:47.060528 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:47.060538 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:47.061010 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:47.061599 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:47.061615 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:47.062613 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:47.062617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:47.063816 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:47.063831 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:47.064510 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:47.064515 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:47.064725 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:47.065595 (+ 870us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:47.065615 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:47.067799 (+ 2184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:47.071188 (+ 3389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:47.071204 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:47.071466 (+ 262us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:47.072044 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:47.072616 (+ 572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:47.072619 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:47.072621 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:47.072824 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:47.073304 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:47.073311 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:47.073641 (+ 330us) client_negotiation.cc:769] Sending connection context
0811 05:03:47.073841 (+ 200us) client_negotiation.cc:240] Negotiation successful
0811 05:03:47.074179 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":238,"threads_started":1}
I20260811 05:03:47.076727 29463 heartbeater.cc:347] Connected to a master server at 127.22.49.254:44563
I20260811 05:03:47.077006 29463 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:47.077685 29463 heartbeater.cc:511] Master 127.22.49.254:44563 requested a full tablet report, sending...
I20260811 05:03:47.079102 28935 ts_manager.cc:194] Registered new tserver with Master: ee792f1ad7bc4f3785f87b47414e17d2 (127.22.49.195:34187)
I20260811 05:03:47.079763 28935 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:33419
I20260811 05:03:47.085429 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/test-admin.keytab.
Aug 11 05:03:47 dist-test-slave-w206 krb5kdc[28887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:47.109642 22727 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 05:03:47.115454 29470 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:03:47.111977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41430 (local address 127.22.49.193:46863)
0811 05:03:47.112478 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:47.112491 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:47.112661 (+ 170us) server_negotiation.cc:407] Connection header received
0811 05:03:47.113160 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:47.113171 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:47.113440 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:47.114112 (+ 672us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:47.115158 (+ 1046us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41430: BlockingRecv error: recv got EOF from 127.0.0.1:41430 (error 108)
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":158,"threads_started":1}
W20260811 05:03:47.116009 22727 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/krb5cc)
Aug 11 05:03:47 dist-test-slave-w206 krb5kdc[28887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:47.117522 22727 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 05:03:47 dist-test-slave-w206 krb5kdc[28887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:47.119833 22727 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 05:03:47 dist-test-slave-w206 krb5kdc[28887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.193@KRBTEST.COM
I20260811 05:03:47.136624 29470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:47.121980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41434 (local address 127.22.49.193:46863)
0811 05:03:47.122241 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:47.122249 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:47.122415 (+ 166us) server_negotiation.cc:407] Connection header received
0811 05:03:47.122625 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:47.122629 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:47.122700 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:47.122870 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:47.124323 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:47.125573 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:47.126838 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:47.127489 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:47.127649 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:47.130800 (+ 3151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:47.130818 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:47.130837 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:47.130880 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:47.134128 (+ 3248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:47.134833 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:47.134841 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:47.134842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:47.134959 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:47.135376 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:47.135380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:47.135382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:47.135713 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:47.136003 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:47.136253 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 05:03:47.136441 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146}
W20260811 05:03:47.141909 29470 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:03:47.140680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41440 (local address 127.22.49.193:46863)
0811 05:03:47.140835 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:47.140840 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:47.140856 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:03:47.141031 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:47.141035 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:47.141093 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:47.141197 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:47.141787 (+ 590us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41440: BlockingRecv error: recv got EOF from 127.0.0.1:41440 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 05:03:47.142357 22727 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/krb5cc' of type FILE
Aug 11 05:03:47 dist-test-slave-w206 krb5kdc[28887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:47.143924 22727 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 05:03:47 dist-test-slave-w206 krb5kdc[28887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:47.145160 22727 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 05:03:47 dist-test-slave-w206 krb5kdc[28887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.193@KRBTEST.COM
I20260811 05:03:47.158711 29470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:47.146599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41454 (local address 127.22.49.193:46863)
0811 05:03:47.146783 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:47.146791 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:47.146842 (+ 51us) server_negotiation.cc:407] Connection header received
0811 05:03:47.147121 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:47.147126 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:47.147175 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:47.147285 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:47.148113 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:47.148738 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:47.149739 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:47.150008 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:47.150148 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:47.154055 (+ 3907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:47.154060 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:47.154063 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:47.154105 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:47.156109 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:47.156829 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:47.156833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:47.156834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:47.156964 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:47.157610 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:47.157614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:47.157616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:47.157912 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:47.158070 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:47.158425 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 05:03:47.158573 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260811 05:03:47.164054 29470 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:03:47.162070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41462 (local address 127.22.49.193:46863)
0811 05:03:47.162263 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:47.162267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:47.162283 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:03:47.162631 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:47.162634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:47.162684 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:47.162770 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:47.163759 (+ 989us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41462: BlockingRecv error: recv got EOF from 127.0.0.1:41462 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
W20260811 05:03:47.164219 22727 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786424592714304-22727-0/krb5kdc/krb5cc' of type FILE
Aug 11 05:03:47 dist-test-slave-w206 krb5kdc[28887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:47.165856 22727 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 05:03:47 dist-test-slave-w206 krb5kdc[28887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:47.167368 22727 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 05:03:47 dist-test-slave-w206 krb5kdc[28887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.193@KRBTEST.COM
I20260811 05:03:47.183234 29470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:47.169099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41466 (local address 127.22.49.193:46863)
0811 05:03:47.169270 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:47.169274 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:47.169714 (+ 440us) server_negotiation.cc:407] Connection header received
0811 05:03:47.169941 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:47.169945 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:47.170004 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:47.170104 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:47.171441 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:47.172035 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:47.173204 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:47.173496 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:47.173646 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:47.178040 (+ 4394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:47.178045 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:47.178048 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:47.178092 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:47.180216 (+ 2124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:47.181159 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:47.181164 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:47.181167 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:47.181301 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:47.181809 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:47.181814 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:47.181816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:47.182131 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:47.182341 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:47.182827 (+ 486us) server_negotiation.cc:299] Negotiation successful
0811 05:03:47.183031 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 05:03:47.185057 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 29006
I20260811 05:03:47.204734 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 29152
I20260811 05:03:47.217008 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 29314
I20260811 05:03:47.226369 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 28900
2026-08-11T05:03:47Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2974 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:03:47 dist-test-slave-w206 krb5kdc[29484](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:03:47 dist-test-slave-w206 krb5kdc[29484](info): set up 2 sockets
Aug 11 05:03:47 dist-test-slave-w206 krb5kdc[29484](info): commencing operation
krb5kdc: starting...
W20260811 05:03:48.457895 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.005s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:03:48 dist-test-slave-w206 krb5kdc[29484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:03:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:48Z Disabled control of system clock
WARNING: no policy specified for oryx/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.254.keytab.
Entry for principal oryx/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.254.keytab.
I20260811 05:03:48.620626 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:37869
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.254.keytab
--principal=oryx/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:37869
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:48.752092 29497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:48.752522 29497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:48.752612 29497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:48.757850 29497 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:48.758014 29497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:48.758068 29497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:48.758107 29497 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:48.758141 29497 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:03:48.765480 29497 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:37869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.254.keytab
--principal=oryx/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:37869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:48.767369 29497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:48.768823 29497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:48.779767 29503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:48.779767 29504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:48.779896 29497 server_base.cc:1034] running on GCE node
W20260811 05:03:48.779820 29506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:48.780825 29497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:48.782241 29497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:48.783493 29497 hybrid_clock.cc:648] HybridClock initialized: now 1786424628783472 us; error 42 us; skew 500 ppm
Aug 11 05:03:48 dist-test-slave-w206 krb5kdc[29484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424628, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:48.787240 29497 init.cc:377] Logged in from keytab as oryx/127.22.49.254@KRBTEST.COM (short username oryx)
I20260811 05:03:48.788775 29497 webserver.cc:460] Webserver started at http://127.22.49.254:34787/ using document root <none> and password file <none>
I20260811 05:03:48.789443 29497 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:48.789520 29497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:48.789726 29497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:48.792551 29497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "1d80c19eca274dce9243bf1c8b6b1c8a"
format_stamp: "Formatted at 2026-08-11 05:03:48 on dist-test-slave-w206"
server_key: "abf413bff9dc13808f1e3f960aed89f0"
server_key_iv: "1b84ab95dec0cfef52582c098672bb85"
server_key_version: "encryptionkey@0"
I20260811 05:03:48.793226 29497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "1d80c19eca274dce9243bf1c8b6b1c8a"
format_stamp: "Formatted at 2026-08-11 05:03:48 on dist-test-slave-w206"
server_key: "abf413bff9dc13808f1e3f960aed89f0"
server_key_iv: "1b84ab95dec0cfef52582c098672bb85"
server_key_version: "encryptionkey@0"
I20260811 05:03:48.798030 29497 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 05:03:48.802021 29516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:48.804030 29497 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 05:03:48.804203 29497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "1d80c19eca274dce9243bf1c8b6b1c8a"
format_stamp: "Formatted at 2026-08-11 05:03:48 on dist-test-slave-w206"
server_key: "abf413bff9dc13808f1e3f960aed89f0"
server_key_iv: "1b84ab95dec0cfef52582c098672bb85"
server_key_version: "encryptionkey@0"
I20260811 05:03:48.804340 29497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:48.828379 29497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:48.832805 29497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:48.833019 29497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:48.842813 29497 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:37869
I20260811 05:03:48.843245 29575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:37869 every 8 connection(s)
I20260811 05:03:48.844177 29497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:48.847683 29576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:48.851181 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 29497
I20260811 05:03:48.851367 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:48.851711 22727 external_mini_cluster.cc:1428] Setting key 81de3995d3f639aaa53415bc20c7a3da
I20260811 05:03:48.855465 29576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a: Bootstrap starting.
I20260811 05:03:48.858904 29576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:48.860005 29576 log.cc:824] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:48.863204 29576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a: No bootstrap required, opened a new log
Aug 11 05:03:48 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
I20260811 05:03:48.868283 29576 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } }
I20260811 05:03:48.868697 29576 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:48.868798 29576 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d80c19eca274dce9243bf1c8b6b1c8a, State: Initialized, Role: FOLLOWER
I20260811 05:03:48.869367 29576 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } }
I20260811 05:03:48.869552 29576 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:48.869655 29576 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:48.869787 29576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:48.871167 29576 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } }
I20260811 05:03:48.871618 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:48.853547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49474 (local address 127.22.49.254:37869)
0811 05:03:48.854077 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:48.854102 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:48.854156 (+ 54us) server_negotiation.cc:407] Connection header received
0811 05:03:48.854894 (+ 738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:48.854915 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:48.855472 (+ 557us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:48.855906 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:48.856975 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:48.858151 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:48.859547 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:48.860480 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:48.860908 (+ 428us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:48.864160 (+ 3252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:48.864169 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:48.864192 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:48.864237 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:48.867601 (+ 3364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:48.868291 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:48.868300 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:48.868309 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:48.868479 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:48.868868 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:48.868872 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:48.868874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:48.869506 (+ 632us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:48.869809 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:48.870117 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 05:03:48.870511 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":188,"threads_started":1}
I20260811 05:03:48.871603 29576 leader_election.cc:302] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d80c19eca274dce9243bf1c8b6b1c8a; no voters:
I20260811 05:03:48.872139 29576 leader_election.cc:288] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:48.872231 29581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:48.872488 29581 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [term 1 LEADER]: Becoming Leader. State: Replica: 1d80c19eca274dce9243bf1c8b6b1c8a, State: Running, Role: LEADER
I20260811 05:03:48.872905 29581 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } }
I20260811 05:03:48.873667 29576 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:48.875083 29582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } }
I20260811 05:03:48.875135 29583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d80c19eca274dce9243bf1c8b6b1c8a. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } }
I20260811 05:03:48.875401 29582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:48.875540 29583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:48.876132 29593 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:48.879840 29593 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:48.887621 29593 catalog_manager.cc:1347] Generated new cluster ID: 5735a0a5b9074484aad2c9fa08cb2402
I20260811 05:03:48.887746 29593 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:48.904474 29593 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:48.905628 29593 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:48.912495 29593 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a: Generated new TSK 0
I20260811 05:03:48.913480 29593 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.193.keytab.
Entry for principal oryx/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.193.keytab.
I20260811 05:03:48.956552 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:37869
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.193.keytab
--principal=oryx/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:49.097222 29605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:49.097587 29605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:49.097638 29605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:49.102557 29605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:49.102663 29605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:49.102730 29605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:03:49.109529 29605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.193.keytab
--principal=oryx/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:37869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:49.110780 29605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:49.111961 29605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:49.124022 29614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:49.124215 29605 server_base.cc:1034] running on GCE node
W20260811 05:03:49.124022 29611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:49.124044 29612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:49.124928 29605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:49.125782 29605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:49.127079 29605 hybrid_clock.cc:648] HybridClock initialized: now 1786424629127055 us; error 69 us; skew 500 ppm
Aug 11 05:03:49 dist-test-slave-w206 krb5kdc[29484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424629, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:49.131256 29605 init.cc:377] Logged in from keytab as oryx/127.22.49.193@KRBTEST.COM (short username oryx)
I20260811 05:03:49.132515 29605 webserver.cc:460] Webserver started at http://127.22.49.193:36053/ using document root <none> and password file <none>
I20260811 05:03:49.133236 29605 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:49.133366 29605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:49.133642 29605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:49.136221 29605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "c8189bebb83a4d8faba846c71da5a898"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "5ec9b2864e9818e104be1987a2e819ea"
server_key_iv: "d105f83a7b4efe87a68b9776851dae51"
server_key_version: "encryptionkey@0"
I20260811 05:03:49.136978 29605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "c8189bebb83a4d8faba846c71da5a898"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "5ec9b2864e9818e104be1987a2e819ea"
server_key_iv: "d105f83a7b4efe87a68b9776851dae51"
server_key_version: "encryptionkey@0"
I20260811 05:03:49.142427 29605 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 05:03:49.147202 29621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:49.149262 29605 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:03:49.149662 29605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "c8189bebb83a4d8faba846c71da5a898"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "5ec9b2864e9818e104be1987a2e819ea"
server_key_iv: "d105f83a7b4efe87a68b9776851dae51"
server_key_version: "encryptionkey@0"
I20260811 05:03:49.149878 29605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:49.166487 29605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:49.172627 29605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:49.172936 29605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:49.174108 29605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:49.175781 29605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:49.175904 29605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:49.175998 29605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:49.176023 29605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:49.188300 29605 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:39001
I20260811 05:03:49.188429 29745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:39001 every 8 connection(s)
I20260811 05:03:49.189496 29605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:03:49.198181 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 29605
I20260811 05:03:49.198407 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:03:49.198755 22727 external_mini_cluster.cc:1428] Setting key 74e398ac64b232cb2e9433ad88c233c0
Aug 11 05:03:49 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424629, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
I20260811 05:03:49.212544 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:49.191998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:52517 (local address 127.22.49.254:37869)
0811 05:03:49.192239 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:49.192245 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:49.193583 (+ 1338us) server_negotiation.cc:407] Connection header received
0811 05:03:49.195905 (+ 2322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:49.195909 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:49.195979 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:49.196083 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:49.197940 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:49.198897 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:49.200977 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:49.201338 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:49.201474 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:49.206637 (+ 5163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:49.206645 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:49.206651 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:49.206698 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:49.209329 (+ 2631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:49.210362 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:49.210366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:49.210367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:49.210525 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:49.211094 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:49.211097 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:49.211098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:49.211327 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:49.211421 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:49.212253 (+ 832us) server_negotiation.cc:299] Negotiation successful
0811 05:03:49.212398 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
WARNING: no policy specified for oryx/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:03:49.213867 29749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:49.192509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.193:52517)
0811 05:03:49.193274 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:49.193382 (+ 108us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:49.195474 (+ 2092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:49.196397 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:49.196407 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:49.196964 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:49.197622 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:49.197641 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:49.199171 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:49.199175 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:49.200795 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:49.200814 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:49.201742 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:49.201748 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:49.202277 (+ 529us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:49.203346 (+ 1069us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:49.203377 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:49.206271 (+ 2894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:49.209608 (+ 3337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:49.209621 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:49.209650 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:49.210193 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:49.210657 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:49.210664 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:49.210668 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:49.210933 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:49.211464 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:49.211473 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:49.211916 (+ 443us) client_negotiation.cc:769] Sending connection context
0811 05:03:49.212191 (+ 275us) client_negotiation.cc:240] Negotiation successful
0811 05:03:49.212684 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":193,"threads_started":1}
I20260811 05:03:49.215739 29746 heartbeater.cc:347] Connected to a master server at 127.22.49.254:37869
I20260811 05:03:49.216171 29746 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.49.194@KRBTEST.COM" created.
I20260811 05:03:49.216998 29746 heartbeater.cc:511] Master 127.22.49.254:37869 requested a full tablet report, sending...
I20260811 05:03:49.219192 29531 ts_manager.cc:194] Registered new tserver with Master: c8189bebb83a4d8faba846c71da5a898 (127.22.49.193:39001)
I20260811 05:03:49.220829 29531 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:52517
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.194.keytab.
Entry for principal oryx/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.194.keytab.
I20260811 05:03:49.240746 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:37869
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.194.keytab
--principal=oryx/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:49.378659 29752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:49.379086 29752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:49.379194 29752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:49.383807 29752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:49.383903 29752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:49.383972 29752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:03:49.390172 29752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.194.keytab
--principal=oryx/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:37869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:49.391571 29752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:49.392783 29752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:49.404589 29757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:49.404559 29758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:49.404624 29752 server_base.cc:1034] running on GCE node
W20260811 05:03:49.404556 29761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:49.405471 29752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:49.406339 29752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:49.407572 29752 hybrid_clock.cc:648] HybridClock initialized: now 1786424629407521 us; error 74 us; skew 500 ppm
Aug 11 05:03:49 dist-test-slave-w206 krb5kdc[29484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424629, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:49.412364 29752 init.cc:377] Logged in from keytab as oryx/127.22.49.194@KRBTEST.COM (short username oryx)
I20260811 05:03:49.413832 29752 webserver.cc:460] Webserver started at http://127.22.49.194:38143/ using document root <none> and password file <none>
I20260811 05:03:49.414697 29752 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:49.414790 29752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:49.415171 29752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:49.417917 29752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "2ad31a850b0e427bbb551eb9dea8d44c"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "1f6328c4a67a6c48fe64d2e9773b24f1"
server_key_iv: "131d4194978a7f3505740fe869e8c521"
server_key_version: "encryptionkey@0"
I20260811 05:03:49.418931 29752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "2ad31a850b0e427bbb551eb9dea8d44c"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "1f6328c4a67a6c48fe64d2e9773b24f1"
server_key_iv: "131d4194978a7f3505740fe869e8c521"
server_key_version: "encryptionkey@0"
I20260811 05:03:49.424512 29752 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 05:03:49.428231 29768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:49.429925 29752 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 05:03:49.430171 29752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "2ad31a850b0e427bbb551eb9dea8d44c"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "1f6328c4a67a6c48fe64d2e9773b24f1"
server_key_iv: "131d4194978a7f3505740fe869e8c521"
server_key_version: "encryptionkey@0"
I20260811 05:03:49.430351 29752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:49.452965 29752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:49.456902 29752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:49.457094 29752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:49.457682 29752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:49.458541 29752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:49.458599 29752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:49.458642 29752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:49.458657 29752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:49.468885 29752 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:43167
I20260811 05:03:49.468981 29897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:43167 every 8 connection(s)
I20260811 05:03:49.469867 29752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:03:49.471764 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 29752
I20260811 05:03:49.471915 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:03:49.472247 22727 external_mini_cluster.cc:1428] Setting key 354902ee8c504662d44ef8c35d110edb
Aug 11 05:03:49 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424629, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.22.49.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.49.195@KRBTEST.COM" created.
I20260811 05:03:49.491500 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:49.472129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:52129 (local address 127.22.49.254:37869)
0811 05:03:49.472282 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:49.472306 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:49.473394 (+ 1088us) server_negotiation.cc:407] Connection header received
0811 05:03:49.475214 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:49.475218 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:49.475280 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:49.475361 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:49.477196 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:49.477856 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:49.479908 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:49.480203 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:49.480312 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:49.484769 (+ 4457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:49.484776 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:49.484783 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:49.484832 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:49.487210 (+ 2378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:49.488303 (+ 1093us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:49.488309 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:49.488311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:49.488728 (+ 417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:49.489444 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:49.489452 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:49.489456 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:49.489858 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:49.489993 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:49.491120 (+ 1127us) server_negotiation.cc:299] Negotiation successful
0811 05:03:49.491350 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 05:03:49.492550 29900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:49.472698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.194:52129)
0811 05:03:49.473241 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:49.473291 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:49.474920 (+ 1629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:49.475568 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:49.475577 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:49.476064 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:49.476945 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:49.476971 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:49.478022 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:49.478029 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:49.479722 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:49.479740 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:49.480421 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:49.480429 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:49.480702 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:49.481609 (+ 907us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:49.481645 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:49.484429 (+ 2784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:49.487526 (+ 3097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:49.487539 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:49.487566 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:49.487985 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:49.488944 (+ 959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:49.488949 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:49.488951 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:49.489187 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:49.490077 (+ 890us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:49.490089 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:49.490567 (+ 478us) client_negotiation.cc:769] Sending connection context
0811 05:03:49.490853 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 05:03:49.491398 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":133,"threads_started":1}
I20260811 05:03:49.494132 29898 heartbeater.cc:347] Connected to a master server at 127.22.49.254:37869
I20260811 05:03:49.494463 29898 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:49.495314 29898 heartbeater.cc:511] Master 127.22.49.254:37869 requested a full tablet report, sending...
I20260811 05:03:49.497043 29531 ts_manager.cc:194] Registered new tserver with Master: 2ad31a850b0e427bbb551eb9dea8d44c (127.22.49.194:43167)
I20260811 05:03:49.497758 29531 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:52129
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.195.keytab.
Entry for principal oryx/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.195.keytab.
I20260811 05:03:49.519706 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:37869
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.195.keytab
--principal=oryx/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:49.655289 29903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:49.655699 29903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:49.655778 29903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:49.660588 29903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:49.660714 29903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:49.660820 29903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:03:49.667567 29903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.195.keytab
--principal=oryx/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:37869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:49.668987 29903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:49.670162 29903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:49.681947 29911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:49.681949 29910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:49.681949 29913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:49.682417 29903 server_base.cc:1034] running on GCE node
I20260811 05:03:49.682850 29903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:49.683722 29903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:49.684945 29903 hybrid_clock.cc:648] HybridClock initialized: now 1786424629684900 us; error 63 us; skew 500 ppm
Aug 11 05:03:49 dist-test-slave-w206 krb5kdc[29484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424629, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:49.688367 29903 init.cc:377] Logged in from keytab as oryx/127.22.49.195@KRBTEST.COM (short username oryx)
I20260811 05:03:49.689483 29903 webserver.cc:460] Webserver started at http://127.22.49.195:34233/ using document root <none> and password file <none>
I20260811 05:03:49.690099 29903 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:49.690176 29903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:49.690394 29903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:49.692989 29903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "6d636ca1a3ab4bf99b43459f0821e1b7"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "f4c7218ddfa1f99237c3332eda50dd9b"
server_key_iv: "1e8d607f45010c31797f5b38c9b97f2d"
server_key_version: "encryptionkey@0"
I20260811 05:03:49.693637 29903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "6d636ca1a3ab4bf99b43459f0821e1b7"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "f4c7218ddfa1f99237c3332eda50dd9b"
server_key_iv: "1e8d607f45010c31797f5b38c9b97f2d"
server_key_version: "encryptionkey@0"
I20260811 05:03:49.698279 29903 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260811 05:03:49.701499 29920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:49.703220 29903 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:03:49.703404 29903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "6d636ca1a3ab4bf99b43459f0821e1b7"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "f4c7218ddfa1f99237c3332eda50dd9b"
server_key_iv: "1e8d607f45010c31797f5b38c9b97f2d"
server_key_version: "encryptionkey@0"
I20260811 05:03:49.703557 29903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:49.727561 29903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:49.732203 29903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:49.732518 29903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:49.733355 29903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:49.734927 29903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:49.735083 29903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 05:03:49.735183 29903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:49.735208 29903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:49.746347 29903 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:39195
I20260811 05:03:49.746392 30045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:39195 every 8 connection(s)
I20260811 05:03:49.747512 29903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:03:49.750248 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 29903
I20260811 05:03:49.750427 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:03:49.750737 22727 external_mini_cluster.cc:1428] Setting key deed0ba7f58bd3b81de91904f07af7b1
Aug 11 05:03:49 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424629, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
I20260811 05:03:49.765424 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:49.749862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:48339 (local address 127.22.49.254:37869)
0811 05:03:49.750064 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:49.750069 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:49.751225 (+ 1156us) server_negotiation.cc:407] Connection header received
0811 05:03:49.752962 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:49.752965 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:49.753027 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:49.753159 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:49.754743 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:49.755416 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:49.756795 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:49.757038 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:49.757162 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:49.760522 (+ 3360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:49.760526 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:49.760528 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:49.760564 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:49.762333 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:49.763142 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:49.763146 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:49.763147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:49.763256 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:49.763780 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:49.763785 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:49.763787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:49.764090 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:49.764212 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:49.765052 (+ 840us) server_negotiation.cc:299] Negotiation successful
0811 05:03:49.765247 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 05:03:49.766462 30048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:49.750323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.195:48339)
0811 05:03:49.751009 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:49.751078 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:49.752651 (+ 1573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:49.753451 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:49.753462 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:49.753956 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:49.754551 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:49.754567 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:49.755570 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:49.755573 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:49.756606 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:49.756619 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:49.757242 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:49.757247 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:49.757466 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:49.758237 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:49.758257 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:49.760230 (+ 1973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:49.762546 (+ 2316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:49.762554 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:49.762572 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:49.762950 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:49.763397 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:49.763400 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:49.763401 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:49.763617 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:49.764251 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:49.764267 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:49.764727 (+ 460us) client_negotiation.cc:769] Sending connection context
0811 05:03:49.764930 (+ 203us) client_negotiation.cc:240] Negotiation successful
0811 05:03:49.765388 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":189,"threads_started":1}
I20260811 05:03:49.768038 30046 heartbeater.cc:347] Connected to a master server at 127.22.49.254:37869
I20260811 05:03:49.768429 30046 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:49.769089 30046 heartbeater.cc:511] Master 127.22.49.254:37869 requested a full tablet report, sending...
I20260811 05:03:49.770689 29531 ts_manager.cc:194] Registered new tserver with Master: 6d636ca1a3ab4bf99b43459f0821e1b7 (127.22.49.195:39195)
I20260811 05:03:49.771526 29531 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:48339
I20260811 05:03:49.778152 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.22.49.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.49.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.49.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.253.keytab.
Entry for principal oryx/127.22.49.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.253.keytab.
I20260811 05:03:49.820444 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.253:40519
--webserver_interface=127.22.49.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.253.keytab
--principal=oryx/127.22.49.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:37869,127.22.49.253:40519
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:49.959251 30052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:49.959594 30052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:49.959642 30052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:49.964244 30052 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:49.964349 30052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:49.964373 30052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:49.964394 30052 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:49.964413 30052 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:03:49.970780 30052 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:37869,127.22.49.253:40519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.253.keytab
--principal=oryx/127.22.49.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.253:40519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.49.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30052
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
W20260811 05:03:49.971174 30052 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.22.49.254:37869,127.22.49.253:40519'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 05:03:49.972308 30052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:49.973599 30052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:49.984251 30059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:49.984272 30058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:49.984287 30062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:49.984290 30052 server_base.cc:1034] running on GCE node
I20260811 05:03:49.985189 30052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:49.986568 30052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:49.987818 30052 hybrid_clock.cc:648] HybridClock initialized: now 1786424629987743 us; error 101 us; skew 500 ppm
Aug 11 05:03:49 dist-test-slave-w206 krb5kdc[29484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424629, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:49.991730 30052 init.cc:377] Logged in from keytab as oryx/127.22.49.253@KRBTEST.COM (short username oryx)
I20260811 05:03:49.992933 30052 webserver.cc:460] Webserver started at http://127.22.49.253:34515/ using document root <none> and password file <none>
I20260811 05:03:49.993602 30052 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:49.993716 30052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:49.993999 30052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:49.996577 30052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/data/instance:
uuid: "471b9d6a44b9466abfc7c728de43d8ee"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "078ae3e018a1ec0babce3ed7200f850e"
server_key_iv: "08fb5d65f1ebed6ceac8b245f4896f43"
server_key_version: "encryptionkey@0"
I20260811 05:03:49.997318 30052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/wal/instance:
uuid: "471b9d6a44b9466abfc7c728de43d8ee"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "078ae3e018a1ec0babce3ed7200f850e"
server_key_iv: "08fb5d65f1ebed6ceac8b245f4896f43"
server_key_version: "encryptionkey@0"
I20260811 05:03:50.002336 30052 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 05:03:50.006040 30070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:50.008255 30052 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 05:03:50.008461 30052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/wal
uuid: "471b9d6a44b9466abfc7c728de43d8ee"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "078ae3e018a1ec0babce3ed7200f850e"
server_key_iv: "08fb5d65f1ebed6ceac8b245f4896f43"
server_key_version: "encryptionkey@0"
I20260811 05:03:50.008708 30052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:50.038430 30052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:50.042770 30052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:50.043076 30052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:50.052738 30052 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.253:40519
I20260811 05:03:50.053118 30125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.253:40519 every 8 connection(s)
I20260811 05:03:50.054154 30052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/data/info.pb
I20260811 05:03:50.057996 30126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:50.061390 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 30052
I20260811 05:03:50.063230 30126 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.49.253@KRBTEST.COM
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424629, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.253@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
I20260811 05:03:50.079768 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.065985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49482 (local address 127.22.49.254:37869)
0811 05:03:50.066119 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.066123 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.066554 (+ 431us) server_negotiation.cc:407] Connection header received
0811 05:03:50.066733 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.066739 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.066795 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.066884 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.067896 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.068500 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.069785 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.070106 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.070222 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.074852 (+ 4630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.074857 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.074863 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.074905 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.077171 (+ 2266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.077941 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.077945 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.077946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.078061 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.078495 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.078500 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.078502 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.078825 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.078934 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.079450 (+ 516us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.079590 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 05:03:50.081039 30131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.065904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:49482)
0811 05:03:50.066396 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.066450 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.066623 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.067060 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.067072 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.067538 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.067722 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.067734 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.068656 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.068660 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.069630 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.069644 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.070306 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.070312 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.070506 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.071228 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.071253 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.074588 (+ 3335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.077377 (+ 2789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.077391 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.077407 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.077820 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.078178 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.078184 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.078186 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.078383 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.078953 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.078961 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.079181 (+ 220us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.079402 (+ 221us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.079830 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":145,"threads_started":1}
I20260811 05:03:50.081037 30129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.063338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34094 (local address 127.22.49.253:40519)
0811 05:03:50.063963 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.063987 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.064040 (+ 53us) server_negotiation.cc:407] Connection header received
0811 05:03:50.064993 (+ 953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.065017 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.065478 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.065829 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.066800 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.068026 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.069164 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.069828 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.070028 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.074539 (+ 4511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.074547 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.074561 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.074619 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.077315 (+ 2696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.077925 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.077933 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.077935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.078128 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.078439 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.078443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.078445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.079035 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.079270 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.079893 (+ 623us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.080066 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":161,"threads_started":1}
I20260811 05:03:50.084141 30126 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424629, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.253@KRBTEST.COM for oryx/127.22.49.253@KRBTEST.COM
I20260811 05:03:50.093236 30131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.084940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:40519 (local address 127.0.0.1:34098)
0811 05:03:50.085132 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.085149 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.085253 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.085496 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.085499 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.085708 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.085799 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.085805 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.086563 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.086568 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.087261 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.087271 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.087750 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.087754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.087850 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.088411 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.088424 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.089894 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.091663 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.091669 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.091671 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.091875 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.092165 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.092168 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.092170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.092252 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.092649 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.092652 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.092744 (+ 92us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.092866 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.093038 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97}
I20260811 05:03:50.093236 30129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.084975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34098 (local address 127.22.49.253:40519)
0811 05:03:50.085132 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.085138 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.085333 (+ 195us) server_negotiation.cc:407] Connection header received
0811 05:03:50.085366 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.085369 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.085415 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.085485 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.085921 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.086445 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.087389 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.087632 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.087748 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.090076 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.090079 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.090081 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.090102 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.091536 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.091977 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.091982 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.091984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.092065 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.092349 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.092352 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.092354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.092550 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.092662 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.092912 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.093117 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":96,"server-negotiator.queue_time_us":66}
I20260811 05:03:50.097316 30126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: Bootstrap starting.
I20260811 05:03:50.100001 30126 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:50.100847 30126 log.cc:824] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:50.103143 30126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: No bootstrap required, opened a new log
I20260811 05:03:50.106384 30126 raft_consensus.cc:348] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } }
I20260811 05:03:50.106648 30126 raft_consensus.cc:374] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:50.106683 30126 raft_consensus.cc:729] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 471b9d6a44b9466abfc7c728de43d8ee, State: Initialized, Role: FOLLOWER
I20260811 05:03:50.107327 30126 consensus_queue.cc:260] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } }
I20260811 05:03:50.108052 30133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } } }
I20260811 05:03:50.108209 30133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:03:50.108850 30126 sys_catalog.cc:564] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: configured and running, proceeding with master startup.
W20260811 05:03:50.115088 30145 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:03:50.115235 30145 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:03:50.117919 30052 master_runner.cc:428] Detected that this master 471b9d6a44b9466abfc7c728de43d8ee is joining an existing cluster
I20260811 05:03:50.118023 30052 master_runner.cc:432] Initiating AddMaster RPC to add 127.22.49.253:40519
I20260811 05:03:50.132728 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.120508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49484 (local address 127.22.49.254:37869)
0811 05:03:50.120664 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.120670 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.120878 (+ 208us) server_negotiation.cc:407] Connection header received
0811 05:03:50.121138 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.121143 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.121203 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.121265 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.122480 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.123112 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.124544 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.125067 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.125182 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.127022 (+ 1840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.127027 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.127030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.127064 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.129552 (+ 2488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.130209 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.130216 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.130218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.130342 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.130770 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.130776 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.130781 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.131751 (+ 970us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.131857 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.132360 (+ 503us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.132542 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 05:03:50.132746 30152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.120423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:49484)
0811 05:03:50.120778 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.120795 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.120975 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.121442 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.121446 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.121891 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.122282 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.122292 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.123231 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.123236 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.124363 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.124376 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.125403 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.125406 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.125507 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.126343 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.126365 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.126811 (+ 446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.129757 (+ 2946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.129761 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.129764 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.130050 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.130477 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.130481 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.130483 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.130621 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.131951 (+ 1330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.131986 (+ 35us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.132158 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.132296 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.132508 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":147,"spinlock_wait_cycles":6272,"thread_start_us":174,"threads_started":1}
I20260811 05:03:50.132889 30129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.120959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34106 (local address 127.22.49.253:40519)
0811 05:03:50.121061 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.121065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.121136 (+ 71us) server_negotiation.cc:407] Connection header received
0811 05:03:50.121269 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.121271 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.121304 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.121348 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.122446 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.123289 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.125434 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.125794 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.125915 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.127778 (+ 1863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.127781 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.127784 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.127807 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.129789 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.130797 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.130801 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.130803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.130934 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.131381 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.131385 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.131388 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.132132 (+ 744us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.132215 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.132526 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.132691 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 05:03:50.133520 30153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.120434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:40519 (local address 127.0.0.1:34106)
0811 05:03:50.121062 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.121077 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.121182 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.121484 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.121490 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.121891 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.122282 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.122292 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.123410 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.123413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.125277 (+ 1864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.125289 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.125953 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.125960 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.126075 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.127038 (+ 963us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.127053 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.127600 (+ 547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.130267 (+ 2667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.130271 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.130273 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.130663 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.131103 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.131106 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.131108 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.131227 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.132277 (+ 1050us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.132280 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.132357 (+ 77us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.132770 (+ 413us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.133321 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"mutex_wait_us":170,"spinlock_wait_cycles":2304,"thread_start_us":155,"threads_started":1}
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424628, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.254@KRBTEST.COM for oryx/127.22.49.253@KRBTEST.COM
WARNING: no policy specified for oryx/127.22.49.252@KRBTEST.COM; defaulting to no policy
I20260811 05:03:50.151053 30155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.140161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:40519 (local address 127.0.0.1:34108)
0811 05:03:50.141051 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.141095 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.141306 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.141685 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.141692 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.142150 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.142277 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.142283 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.143158 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.143161 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.143850 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.143860 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.144365 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.144369 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.144510 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.145196 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.145209 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.146881 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.148922 (+ 2041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.148938 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.148947 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.149243 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.149600 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.149604 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.149606 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.149711 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.150257 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.150268 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.150418 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.150585 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.150838 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"thread_start_us":136,"threads_started":1}
I20260811 05:03:50.151052 30129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.140195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34108 (local address 127.22.49.253:40519)
0811 05:03:50.140364 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.140369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.141204 (+ 835us) server_negotiation.cc:407] Connection header received
0811 05:03:50.141469 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.141472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.141538 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.141640 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.142416 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.142961 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.143990 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.144228 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.144359 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.147122 (+ 2763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.147126 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.147128 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.147158 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.148763 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.149379 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.149383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.149387 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.149480 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.149900 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.149907 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.149909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.150128 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.150249 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.150641 (+ 392us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.150777 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.49.252@KRBTEST.COM" created.
I20260811 05:03:50.153138 29531 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.22.49.253:40519: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee"
member_type: NON_VOTER
last_known_addr {
host: "127.22.49.253"
port: 40519
}
attrs {
promote: true
}
}
dest_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a"
cas_config_opid_index: -1
I20260811 05:03:50.154318 29531 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: NON_VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: true } }
I20260811 05:03:50.157011 30159 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 471b9d6a44b9466abfc7c728de43d8ee (127.22.49.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: NON_VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: true } } }
I20260811 05:03:50.158216 30096 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:50.159703 30159 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.22.49.253:40519
I20260811 05:03:50.159993 30158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: NON_VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: true } } }
I20260811 05:03:50.160115 30158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:50.160810 30096 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 FOLLOWER]: Refusing update from remote peer 1d80c19eca274dce9243bf1c8b6b1c8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 05:03:50.162389 30052 master.cc:537] Master@127.22.49.253:40519 shutting down...
I20260811 05:03:50.162770 30158 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: NON_VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 05:03:50.166046 29518 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 05:03:50.167390 29518 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a -> Peer 471b9d6a44b9466abfc7c728de43d8ee (127.22.49.253:40519): Couldn't send request to peer 471b9d6a44b9466abfc7c728de43d8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 05:03:50.171171 30052 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:50.171640 30052 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:50.171820 30052 tablet_replica.cc:330] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.49.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.252.keytab.
Entry for principal oryx/127.22.49.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.252.keytab.
I20260811 05:03:50.188184 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.252:42483
--webserver_interface=127.22.49.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.252.keytab
--principal=oryx/127.22.49.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:37869,127.22.49.253:40519,127.22.49.252:42483
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:03:50.191843 30052 master.cc:552] Master@127.22.49.253:40519 shutdown complete.
I20260811 05:03:50.191949 30052 master_runner.cc:305] Clearing existing system tablet
I20260811 05:03:50.192250 30052 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:50.192332 30052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:50.193933 30052 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 05:03:50.195111 30164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:50.195348 30052 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:50.195529 30052 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:50.195567 30052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/wal
uuid: "471b9d6a44b9466abfc7c728de43d8ee"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "078ae3e018a1ec0babce3ed7200f850e"
server_key_iv: "08fb5d65f1ebed6ceac8b245f4896f43"
server_key_version: "encryptionkey@0"
I20260811 05:03:50.198535 30052 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:50.201534 30052 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 05:03:50.201675 30052 log.cc:1196] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 05:03:50.201949 30052 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: Deleting consensus metadata
I20260811 05:03:50.202512 30052 master_runner.cc:315] Copying system tablet from 127.22.49.254:37869
I20260811 05:03:50.204597 30052 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: tablet copy: Beginning tablet copy session from remote peer at address 127.22.49.254:37869
I20260811 05:03:50.219743 30170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.205566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:49492)
0811 05:03:50.205911 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.205931 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.206091 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.206956 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.206964 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.207278 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.207496 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.207506 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.209022 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.209026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.210380 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.210397 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.211443 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.211446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.211529 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.212185 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.212206 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.212685 (+ 479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.217254 (+ 4569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.217259 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.217262 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.217634 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.218016 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.218021 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.218025 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.218184 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.218921 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.218924 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.219112 (+ 188us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.219277 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.219489 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":119,"threads_started":1}
I20260811 05:03:50.219730 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.205686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49492 (local address 127.22.49.254:37869)
0811 05:03:50.205843 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.205848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.206029 (+ 181us) server_negotiation.cc:407] Connection header received
0811 05:03:50.206212 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.206215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.206292 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.206748 (+ 456us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.207701 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.208855 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.210737 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.211148 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.211226 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.212876 (+ 1650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.212880 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.212882 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.212912 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.217070 (+ 4158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.217769 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.217773 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.217775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.217882 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.218316 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.218320 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.218322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.218789 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.218929 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.219378 (+ 449us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.219532 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 05:03:50.221115 29559 tablet_copy_service.cc:140] P 1d80c19eca274dce9243bf1c8b6b1c8a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 471b9d6a44b9466abfc7c728de43d8ee ({username='oryx', principal='oryx/127.22.49.253@KRBTEST.COM'} at 127.0.0.1:49492)
I20260811 05:03:50.221377 29559 tablet_copy_service.cc:161] P 1d80c19eca274dce9243bf1c8b6b1c8a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 471b9d6a44b9466abfc7c728de43d8ee at {username='oryx', principal='oryx/127.22.49.253@KRBTEST.COM'} at 127.0.0.1:49492: session id = 471b9d6a44b9466abfc7c728de43d8ee-00000000000000000000000000000000
I20260811 05:03:50.223284 29559 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 05:03:50.224793 29746 heartbeater.cc:503] Master 127.22.49.254:37869 was elected leader, sending a full tablet report...
I20260811 05:03:50.225558 30052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 05:03:50.228299 30052 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: tablet copy: Starting download of 0 data blocks...
I20260811 05:03:50.228577 30052 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: tablet copy: Starting download of 1 WAL segments...
I20260811 05:03:50.230652 30052 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 05:03:50.247203 29559 tablet_copy_service.cc:342] P 1d80c19eca274dce9243bf1c8b6b1c8a: Request end of tablet copy session 471b9d6a44b9466abfc7c728de43d8ee-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.22.49.253@KRBTEST.COM'} at 127.0.0.1:49492
I20260811 05:03:50.247452 29559 tablet_copy_service.cc:433] P 1d80c19eca274dce9243bf1c8b6b1c8a: ending tablet copy session 471b9d6a44b9466abfc7c728de43d8ee-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 471b9d6a44b9466abfc7c728de43d8ee
I20260811 05:03:50.259498 30052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:50.261852 30175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:50.261871 30171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:50.262635 30052 server_base.cc:1034] running on GCE node
W20260811 05:03:50.265766 30173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:50.266113 30052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:50.266503 30052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:50.267666 30052 hybrid_clock.cc:648] HybridClock initialized: now 1786424630267643 us; error 48 us; skew 500 ppm
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424630, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:50.269362 30052 init.cc:377] Logged in from keytab as oryx/127.22.49.253@KRBTEST.COM (short username oryx)
I20260811 05:03:50.269997 30052 webserver.cc:460] Webserver started at http://127.22.49.253:35633/ using document root <none> and password file <none>
I20260811 05:03:50.270210 30052 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:50.270268 30052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:50.271523 30052 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:50.272549 30182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:50.272781 30052 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:50.272859 30052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/wal
uuid: "471b9d6a44b9466abfc7c728de43d8ee"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "078ae3e018a1ec0babce3ed7200f850e"
server_key_iv: "08fb5d65f1ebed6ceac8b245f4896f43"
server_key_version: "encryptionkey@0"
I20260811 05:03:50.272948 30052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:50.282167 30052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:50.284574 30052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:50.290940 30052 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.253:40519
I20260811 05:03:50.290958 30238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.253:40519 every 8 connection(s)
I20260811 05:03:50.291610 30052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-1/data/info.pb
I20260811 05:03:50.293303 30240 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:03:50.294225 30240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: Bootstrap starting.
I20260811 05:03:50.303690 30240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:03:50.304068 30240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: Bootstrap complete.
I20260811 05:03:50.304664 30240 raft_consensus.cc:348] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: NON_VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: true } }
I20260811 05:03:50.304807 30240 raft_consensus.cc:729] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 471b9d6a44b9466abfc7c728de43d8ee, State: Initialized, Role: LEARNER
I20260811 05:03:50.304939 30240 consensus_queue.cc:260] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: NON_VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: true } }
I20260811 05:03:50.305320 30243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: NON_VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: true } } }
I20260811 05:03:50.305495 30240 sys_catalog.cc:564] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:50.305505 30243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: This master's current role is: LEARNER
I20260811 05:03:50.309873 30254 catalog_manager.cc:1259] Loaded cluster ID: 5735a0a5b9074484aad2c9fa08cb2402
I20260811 05:03:50.309957 30254 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: loading cluster ID for follower catalog manager: success
I20260811 05:03:50.311790 30254 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: acquiring CA information for follower catalog manager: success
I20260811 05:03:50.313076 30254 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 05:03:50.368549 30162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:50.368896 30162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:50.368940 30162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:50.373171 30162 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:50.373250 30162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:50.373270 30162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:50.373287 30162 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:50.373303 30162 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:03:50.379540 30162 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:37869,127.22.49.253:40519,127.22.49.252:42483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.252.keytab
--principal=oryx/127.22.49.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.252:42483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.49.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:50.380848 30162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:50.381984 30162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:50.391367 30263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:50.391602 30162 server_base.cc:1034] running on GCE node
W20260811 05:03:50.391288 30260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:50.391286 30261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:50.392397 30162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:50.393708 30162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:50.394930 30162 hybrid_clock.cc:648] HybridClock initialized: now 1786424630394907 us; error 45 us; skew 500 ppm
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424630, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:50.398212 30162 init.cc:377] Logged in from keytab as oryx/127.22.49.252@KRBTEST.COM (short username oryx)
I20260811 05:03:50.399461 30162 webserver.cc:460] Webserver started at http://127.22.49.252:32835/ using document root <none> and password file <none>
I20260811 05:03:50.400123 30162 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:50.400228 30162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:50.400494 30162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:50.402814 30162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/data/instance:
uuid: "aca99b03ee8b418cae663dc5ffb91178"
format_stamp: "Formatted at 2026-08-11 05:03:50 on dist-test-slave-w206"
server_key: "46c99387cb74450c69c36e24b7c61fa1"
server_key_iv: "cc2096eb7c73d5a986cb5aaf04e5898f"
server_key_version: "encryptionkey@0"
I20260811 05:03:50.403560 30162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/wal/instance:
uuid: "aca99b03ee8b418cae663dc5ffb91178"
format_stamp: "Formatted at 2026-08-11 05:03:50 on dist-test-slave-w206"
server_key: "46c99387cb74450c69c36e24b7c61fa1"
server_key_iv: "cc2096eb7c73d5a986cb5aaf04e5898f"
server_key_version: "encryptionkey@0"
I20260811 05:03:50.407950 30162 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:03:50.410887 30271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:50.412467 30162 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:03:50.412597 30162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/wal
uuid: "aca99b03ee8b418cae663dc5ffb91178"
format_stamp: "Formatted at 2026-08-11 05:03:50 on dist-test-slave-w206"
server_key: "46c99387cb74450c69c36e24b7c61fa1"
server_key_iv: "cc2096eb7c73d5a986cb5aaf04e5898f"
server_key_version: "encryptionkey@0"
I20260811 05:03:50.412704 30162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:50.436972 30162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:50.440572 30162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:50.440759 30162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:50.450709 30162 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.252:42483
I20260811 05:03:50.451190 30330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.252:42483 every 8 connection(s)
I20260811 05:03:50.452034 30162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/data/info.pb
I20260811 05:03:50.455407 30331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:50.459619 30331 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:03:50.462064 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 30162
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424630, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.252@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.49.252@KRBTEST.COM
I20260811 05:03:50.476503 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.462104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49506 (local address 127.22.49.254:37869)
0811 05:03:50.462273 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.462289 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.463137 (+ 848us) server_negotiation.cc:407] Connection header received
0811 05:03:50.464261 (+ 1124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.464264 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.464317 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.464468 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.465630 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.466469 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.468037 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.468450 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.468570 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.471825 (+ 3255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.471830 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.471833 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.471864 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.473793 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.474537 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.474540 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.474541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.474630 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.475055 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.475059 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.475061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.475359 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.475482 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.476151 (+ 669us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.476312 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 05:03:50.477396 30334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.462966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50296 (local address 127.22.49.252:42483)
0811 05:03:50.463465 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.463475 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.463509 (+ 34us) server_negotiation.cc:407] Connection header received
0811 05:03:50.464064 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.464093 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.464355 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.464549 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.465488 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.466782 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.468037 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.468613 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.468777 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.472281 (+ 3504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.472289 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.472305 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.472339 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.474639 (+ 2300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.475188 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.475193 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.475194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.475267 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.475572 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.475574 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.475575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.475867 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.476017 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.476308 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.476491 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":152,"server-negotiator.queue_time_us":363,"thread_start_us":157,"threads_started":1}
I20260811 05:03:50.477401 30333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.462362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:49506)
0811 05:03:50.462937 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.463036 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.464044 (+ 1008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.464570 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.464575 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.465081 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.465482 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.465504 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.466619 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.466622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.467900 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.467910 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.468610 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.468612 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.468777 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.469571 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.469597 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.471587 (+ 1990us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.473924 (+ 2337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.473932 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.473944 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.474392 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.474748 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.474751 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.474753 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.474901 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.475546 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.475556 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.475859 (+ 303us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.476060 (+ 201us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.476431 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":1,"spinlock_wait_cycles":2944,"thread_start_us":197,"threads_started":1}
I20260811 05:03:50.479135 30331 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424630, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.252@KRBTEST.COM for oryx/127.22.49.253@KRBTEST.COM
I20260811 05:03:50.488834 30333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.479695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:40519 (local address 127.0.0.1:34112)
0811 05:03:50.479833 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.479850 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.479930 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.480431 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.480433 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.480594 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.480702 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.480706 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.481639 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.481641 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.482237 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.482246 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.482733 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.482737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.482831 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.483441 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.483454 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.484908 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.487228 (+ 2320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.487231 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.487233 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.487517 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.487861 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.487863 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.487864 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.487944 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.488379 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.488382 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.488476 (+ 94us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.488573 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.488697 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 05:03:50.488902 30335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.479882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34112 (local address 127.22.49.253:40519)
0811 05:03:50.480188 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.480192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.480204 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:03:50.480242 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.480244 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.480282 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.480360 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.480838 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.481524 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.482349 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.482570 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.482656 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.485100 (+ 2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.485104 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.485106 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.485134 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.487104 (+ 1970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.487654 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.487658 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.487659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.487759 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.488033 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.488035 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.488036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.488252 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.488340 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.488640 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.488764 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":125,"threads_started":1}
I20260811 05:03:50.489836 30331 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424630, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.252@KRBTEST.COM for oryx/127.22.49.252@KRBTEST.COM
I20260811 05:03:50.498802 30333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.490379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:42483 (local address 127.0.0.1:50312)
0811 05:03:50.490523 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.490540 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.490635 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.490904 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.490907 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.491146 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.491221 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.491227 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.492035 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.492042 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.492608 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.492615 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.493119 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.493123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.493199 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.493768 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.493781 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.495148 (+ 1367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.496931 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.496935 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.496938 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.497142 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.497637 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.497643 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.497646 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.497742 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.498186 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.498190 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.498282 (+ 92us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.498404 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.498571 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 05:03:50.498802 30334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.490418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50312 (local address 127.22.49.252:42483)
0811 05:03:50.490541 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.490547 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.490589 (+ 42us) server_negotiation.cc:407] Connection header received
0811 05:03:50.490737 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.490741 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.490801 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.490896 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.491338 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.491905 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.492731 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.492997 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.493119 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.495304 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.495307 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.495309 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.495332 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.496740 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.497361 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.497364 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.497367 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.497526 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.497837 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.497844 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.497846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.498080 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.498202 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.498509 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.498626 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 05:03:50.501822 29898 heartbeater.cc:503] Master 127.22.49.254:37869 was elected leader, sending a full tablet report...
I20260811 05:03:50.503214 30331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: Bootstrap starting.
I20260811 05:03:50.505815 30331 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:50.506817 30331 log.cc:824] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:50.509536 30331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: No bootstrap required, opened a new log
I20260811 05:03:50.513386 30331 raft_consensus.cc:348] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } }
I20260811 05:03:50.513697 30331 raft_consensus.cc:374] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:50.513787 30331 raft_consensus.cc:729] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aca99b03ee8b418cae663dc5ffb91178, State: Initialized, Role: FOLLOWER
I20260811 05:03:50.514305 30331 consensus_queue.cc:260] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } }
I20260811 05:03:50.514912 30338 sys_catalog.cc:455] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } } }
I20260811 05:03:50.515115 30338 sys_catalog.cc:458] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:03:50.515866 30331 sys_catalog.cc:564] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 05:03:50.522073 30351 catalog_manager.cc:1558] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:03:50.522192 30351 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:03:50.526661 30162 master_runner.cc:428] Detected that this master aca99b03ee8b418cae663dc5ffb91178 is joining an existing cluster
I20260811 05:03:50.526746 30162 master_runner.cc:432] Initiating AddMaster RPC to add 127.22.49.252:42483
I20260811 05:03:50.532367 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 29605
I20260811 05:03:50.539942 30335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.530272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34116 (local address 127.22.49.253:40519)
0811 05:03:50.530445 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.530450 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.530463 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:03:50.530512 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.530514 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.530580 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.530661 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.531422 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.532020 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.533907 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.534155 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.534304 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.536441 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.536444 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.536447 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.536472 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.538072 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.538554 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.538557 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.538559 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.538639 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.538943 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.538948 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.538950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.539256 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.539363 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.539638 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.539771 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 05:03:50.539978 30359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.529282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:40519 (local address 127.0.0.1:34116)
0811 05:03:50.530132 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.530148 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.530257 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.530819 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.530822 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.531149 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.531275 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.531284 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.532145 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.532148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.533768 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.533780 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.534876 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.534879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.534957 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.535693 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.535709 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.536258 (+ 549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.538200 (+ 1942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.538205 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.538207 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.538434 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.538749 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.538752 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.538754 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.538848 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.539351 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.539354 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.539465 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.539575 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.539761 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":783,"spinlock_wait_cycles":12544,"thread_start_us":157,"threads_started":1}
I20260811 05:03:50.547166 30359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.529880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:42483 (local address 127.0.0.1:50316)
0811 05:03:50.540327 (+ 10447us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.540345 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.540437 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.540699 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.540701 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.540851 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.540966 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.540972 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.541792 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.541794 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.542278 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.542283 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.542717 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.542720 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.542814 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.543378 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.543398 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.543723 (+ 325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.545571 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.545576 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.545578 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.545785 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.546063 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.546066 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.546068 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.546149 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.546577 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.546580 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.546671 (+ 91us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.546775 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.546934 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10360,"thread_start_us":104,"threads_started":1}
I20260811 05:03:50.547166 30334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.529892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50316 (local address 127.22.49.252:42483)
0811 05:03:50.530251 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.530255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.540386 (+ 10131us) server_negotiation.cc:407] Connection header received
0811 05:03:50.540515 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.540518 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.540550 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.540592 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.541077 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.541688 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.542387 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.542607 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.542714 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.543878 (+ 1164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.543882 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.543884 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.543907 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.545441 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.545884 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.545890 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.545893 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.545970 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.546241 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.546245 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.546247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.546473 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.546579 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.546829 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.547024 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":303}
I20260811 05:03:50.557559 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:39001
--local_ip_for_outbound_sockets=127.22.49.193
--tserver_master_addrs=127.22.49.254:37869
--webserver_port=36053
--webserver_interface=127.22.49.193
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.193.keytab
--principal=oryx/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.22.49.254:37869,127.22.49.253:40519
--tserver_master_addrs=127.22.49.254:37869,127.22.49.253:40519,127.22.49.252:42483 with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:03:50.559856 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.529388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49520 (local address 127.22.49.254:37869)
0811 05:03:50.529557 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.529562 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.529892 (+ 330us) server_negotiation.cc:407] Connection header received
0811 05:03:50.530116 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.530122 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.530204 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.530266 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.531276 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.532134 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.553696 (+ 21562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.554177 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.554342 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.555848 (+ 1506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.555854 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.555861 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.555900 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.557756 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.558351 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.558355 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.558357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.558457 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.558791 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.558795 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.558797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.559086 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.559189 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.559577 (+ 388us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.559720 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 05:03:50.560491 30358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.529265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:49520)
0811 05:03:50.529796 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.529814 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.529989 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.530623 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.530626 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.530943 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.531125 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.531134 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.552489 (+ 21355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.552493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.553490 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.553502 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.554346 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.554350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.554458 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.555134 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.555149 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.555679 (+ 530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.557915 (+ 2236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.557921 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.557925 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.558214 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.558561 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.558567 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.558571 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.558680 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.559192 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.559197 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.559332 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.560078 (+ 746us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.560255 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":179,"threads_started":1}
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424628, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.254@KRBTEST.COM for oryx/127.22.49.252@KRBTEST.COM
I20260811 05:03:50.591310 30334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.564923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50318 (local address 127.22.49.252:42483)
0811 05:03:50.565290 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.565294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.565305 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:03:50.565372 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.565374 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.565419 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.565519 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.565996 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.566637 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.567865 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.568121 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.568246 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.570610 (+ 2364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.570614 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.570617 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.570652 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.589185 (+ 18533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.589799 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.589804 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.589806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.589912 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.590267 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.590271 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.590273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.590510 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.590638 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.590934 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.591113 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297}
I20260811 05:03:50.591310 30155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.564854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:42483 (local address 127.0.0.1:50318)
0811 05:03:50.565062 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.565075 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.565155 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.565537 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.565541 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.565770 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.565870 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.565876 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.566762 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.566768 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.567705 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.567717 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.568253 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.568257 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.568369 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.568957 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.568980 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.570446 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.589377 (+ 18931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.589382 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.589384 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.589662 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.590034 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.590037 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.590040 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.590151 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.590630 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.590634 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.590747 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.590869 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.591117 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117}
I20260811 05:03:50.592801 29531 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.22.49.252:42483: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178"
member_type: NON_VOTER
last_known_addr {
host: "127.22.49.252"
port: 42483
}
attrs {
promote: true
}
}
dest_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a"
cas_config_opid_index: 5
I20260811 05:03:50.593441 29531 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: NON_VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: true } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } }
I20260811 05:03:50.594714 30158 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER aca99b03ee8b418cae663dc5ffb91178 (127.22.49.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: NON_VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: true } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } } }
I20260811 05:03:50.596156 30158 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.22.49.252:42483
I20260811 05:03:50.596386 30158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: NON_VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: true } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } } }
I20260811 05:03:50.596514 30158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:50.597587 30162 master.cc:537] Master@127.22.49.252:42483 shutting down...
I20260811 05:03:50.598117 30303 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:50.599604 30303 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 1 FOLLOWER]: Refusing update from remote peer 1d80c19eca274dce9243bf1c8b6b1c8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 05:03:50.600498 30159 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 05:03:50.603108 29519 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a -> Peer aca99b03ee8b418cae663dc5ffb91178 (127.22.49.252:42483): Couldn't send request to peer aca99b03ee8b418cae663dc5ffb91178. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 05:03:50.609869 30162 raft_consensus.cc:2229] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:50.610067 30335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.597177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34126 (local address 127.22.49.253:40519)
0811 05:03:50.603930 (+ 6753us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.603934 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.603951 (+ 17us) server_negotiation.cc:407] Connection header received
0811 05:03:50.604007 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.604009 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.604069 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.604200 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:50.604579 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.605550 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.607776 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.608622 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.608786 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.608981 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.609753 (+ 772us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.609907 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6633}
I20260811 05:03:50.610410 30155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.596923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:40519 (local address 127.0.0.1:34126)
0811 05:03:50.597049 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.597068 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.597169 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.604237 (+ 7068us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.604241 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.604268 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:50.604404 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.604426 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.605705 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.605712 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.607504 (+ 1792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.607524 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.609112 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.609119 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.609255 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.609322 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.609474 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.609592 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 05:03:50.610767 30162 raft_consensus.cc:2258] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:50.611003 30162 tablet_replica.cc:330] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: stopping tablet replica
I20260811 05:03:50.611145 30211 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 LEARNER]: Refusing update from remote peer 1d80c19eca274dce9243bf1c8b6b1c8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 05:03:50.611680 30159 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: NON_VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 05:03:50.613816 30211 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER aca99b03ee8b418cae663dc5ffb91178 (127.22.49.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: NON_VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: true } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } } }
I20260811 05:03:50.615978 30243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d80c19eca274dce9243bf1c8b6b1c8a. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: NON_VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: true } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } } }
I20260811 05:03:50.616112 30243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: This master's current role is: LEARNER
I20260811 05:03:50.616214 30243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: NON_VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: true } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } } }
I20260811 05:03:50.616315 30243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: This master's current role is: LEARNER
I20260811 05:03:50.616921 30159 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a: attempting to promote NON_VOTER 471b9d6a44b9466abfc7c728de43d8ee to VOTER
I20260811 05:03:50.617530 30159 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } }
I20260811 05:03:50.619249 30211 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 LEARNER]: Refusing update from remote peer 1d80c19eca274dce9243bf1c8b6b1c8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 05:03:50.619793 30363 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260811 05:03:50.620357 29519 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a -> Peer aca99b03ee8b418cae663dc5ffb91178 (127.22.49.252:42483): Couldn't send request to peer aca99b03ee8b418cae663dc5ffb91178. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 05:03:50.622186 30158 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 471b9d6a44b9466abfc7c728de43d8ee (127.22.49.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } } }
I20260811 05:03:50.623152 30209 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 471b9d6a44b9466abfc7c728de43d8ee (127.22.49.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } } }
I20260811 05:03:50.625223 30162 master.cc:552] Master@127.22.49.252:42483 shutdown complete.
I20260811 05:03:50.625276 30162 master_runner.cc:305] Clearing existing system tablet
I20260811 05:03:50.625674 30243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } } }
I20260811 05:03:50.625845 30162 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:50.625857 30243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:03:50.625936 30162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:50.627665 30162 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:50.628671 30367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:50.628585 30159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } } }
I20260811 05:03:50.628734 30159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:50.628875 30162 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:50.629030 30162 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:50.629079 30162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/wal
uuid: "aca99b03ee8b418cae663dc5ffb91178"
format_stamp: "Formatted at 2026-08-11 05:03:50 on dist-test-slave-w206"
server_key: "46c99387cb74450c69c36e24b7c61fa1"
server_key_iv: "cc2096eb7c73d5a986cb5aaf04e5898f"
server_key_version: "encryptionkey@0"
I20260811 05:03:50.629500 30159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } } }
I20260811 05:03:50.629631 30159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:50.631482 30162 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:50.633695 30162 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 05:03:50.633832 30162 log.cc:1196] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 05:03:50.634119 30162 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: Deleting consensus metadata
I20260811 05:03:50.634402 30162 master_runner.cc:315] Copying system tablet from 127.22.49.254:37869
I20260811 05:03:50.636058 30162 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: tablet copy: Beginning tablet copy session from remote peer at address 127.22.49.254:37869
I20260811 05:03:50.645344 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.636831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49528 (local address 127.22.49.254:37869)
0811 05:03:50.636987 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.636994 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.637267 (+ 273us) server_negotiation.cc:407] Connection header received
0811 05:03:50.637467 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.637470 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.637528 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.637630 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.638162 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.638762 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.639829 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.640098 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.640234 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.641568 (+ 1334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.641572 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.641578 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.641611 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.643386 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.643910 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.643913 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.643916 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.644015 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.644337 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.644343 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.644345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.644571 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.644695 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.645014 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.645144 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 05:03:50.645370 30373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.636733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:49528)
0811 05:03:50.637158 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.637172 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.637326 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.637652 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.637655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.637904 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.638027 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.638033 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.638897 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.638901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.639686 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.639697 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.640245 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.640249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.640343 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.640994 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.641009 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.641396 (+ 387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.643534 (+ 2138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.643538 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.643540 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.643790 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.644123 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.644127 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.644129 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.644231 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.644683 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.644687 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.644807 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.644949 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.645138 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":117,"threads_started":1}
I20260811 05:03:50.646379 29559 tablet_copy_service.cc:140] P 1d80c19eca274dce9243bf1c8b6b1c8a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer aca99b03ee8b418cae663dc5ffb91178 ({username='oryx', principal='oryx/127.22.49.252@KRBTEST.COM'} at 127.0.0.1:49528)
I20260811 05:03:50.646512 29559 tablet_copy_service.cc:161] P 1d80c19eca274dce9243bf1c8b6b1c8a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer aca99b03ee8b418cae663dc5ffb91178 at {username='oryx', principal='oryx/127.22.49.252@KRBTEST.COM'} at 127.0.0.1:49528: session id = aca99b03ee8b418cae663dc5ffb91178-00000000000000000000000000000000
I20260811 05:03:50.647614 29559 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 05:03:50.649030 30162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 05:03:50.651360 30162 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: tablet copy: Starting download of 0 data blocks...
I20260811 05:03:50.651604 30162 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: tablet copy: Starting download of 1 WAL segments...
I20260811 05:03:50.653322 30162 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 05:03:50.655242 29559 tablet_copy_service.cc:342] P 1d80c19eca274dce9243bf1c8b6b1c8a: Request end of tablet copy session aca99b03ee8b418cae663dc5ffb91178-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.22.49.252@KRBTEST.COM'} at 127.0.0.1:49528
I20260811 05:03:50.655365 29559 tablet_copy_service.cc:433] P 1d80c19eca274dce9243bf1c8b6b1c8a: ending tablet copy session aca99b03ee8b418cae663dc5ffb91178-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer aca99b03ee8b418cae663dc5ffb91178
I20260811 05:03:50.663304 30162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:50.665563 30374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:50.665793 30377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:50.666138 30162 server_base.cc:1034] running on GCE node
W20260811 05:03:50.666456 30375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:50.666868 30162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:50.667333 30162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:50.668556 30162 hybrid_clock.cc:648] HybridClock initialized: now 1786424630668569 us; error 55 us; skew 500 ppm
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424630, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:50.670249 30162 init.cc:377] Logged in from keytab as oryx/127.22.49.252@KRBTEST.COM (short username oryx)
I20260811 05:03:50.670848 30162 webserver.cc:460] Webserver started at http://127.22.49.252:39087/ using document root <none> and password file <none>
I20260811 05:03:50.671098 30162 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:50.671162 30162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:50.672410 30162 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:03:50.673573 30385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:50.673954 30162 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 05:03:50.674031 30162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/wal
uuid: "aca99b03ee8b418cae663dc5ffb91178"
format_stamp: "Formatted at 2026-08-11 05:03:50 on dist-test-slave-w206"
server_key: "46c99387cb74450c69c36e24b7c61fa1"
server_key_iv: "cc2096eb7c73d5a986cb5aaf04e5898f"
server_key_version: "encryptionkey@0"
I20260811 05:03:50.674126 30162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:50.691843 30162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:50.694147 30162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:50.699615 30162 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.252:42483
I20260811 05:03:50.699627 30442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.252:42483 every 8 connection(s)
I20260811 05:03:50.700266 30162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/master-2/data/info.pb
I20260811 05:03:50.702841 30443 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:03:50.703835 30443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: Bootstrap starting.
I20260811 05:03:50.714315 30443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:03:50.714715 30443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: Bootstrap complete.
I20260811 05:03:50.715348 30443 raft_consensus.cc:348] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } }
I20260811 05:03:50.715499 30443 raft_consensus.cc:729] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: aca99b03ee8b418cae663dc5ffb91178, State: Initialized, Role: LEARNER
I20260811 05:03:50.715617 30443 consensus_queue.cc:260] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } }
I20260811 05:03:50.716014 30446 sys_catalog.cc:455] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } } }
I20260811 05:03:50.716187 30443 sys_catalog.cc:564] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:50.716192 30446 sys_catalog.cc:458] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [sys.catalog]: This master's current role is: LEARNER
I20260811 05:03:50.720489 30458 catalog_manager.cc:1259] Loaded cluster ID: 5735a0a5b9074484aad2c9fa08cb2402
I20260811 05:03:50.720589 30458 catalog_manager.cc:1552] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: loading cluster ID for follower catalog manager: success
I20260811 05:03:50.722271 30458 catalog_manager.cc:1574] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: acquiring CA information for follower catalog manager: success
I20260811 05:03:50.723543 30458 catalog_manager.cc:1602] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 05:03:50.731019 30360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:50.731415 30360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:50.731487 30360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:50.737843 30360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:50.737946 30360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:50.738039 30360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:03:50.747268 30360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.193.keytab
--principal=oryx/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:39001
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=36053
--tserver_master_addrs=127.22.49.254:37869,127.22.49.253:40519,127.22.49.252:42483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:50.748603 30360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:50.749897 30360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:50.763186 30464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:50.763186 30466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:50.763419 30360 server_base.cc:1034] running on GCE node
W20260811 05:03:50.763573 30468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:50.764096 30360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:50.764813 30360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:50.766043 30360 hybrid_clock.cc:648] HybridClock initialized: now 1786424630766026 us; error 33 us; skew 500 ppm
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424630, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:50.769606 30360 init.cc:377] Logged in from keytab as oryx/127.22.49.193@KRBTEST.COM (short username oryx)
I20260811 05:03:50.770622 30360 webserver.cc:460] Webserver started at http://127.22.49.193:36053/ using document root <none> and password file <none>
I20260811 05:03:50.771322 30360 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:50.771451 30360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:50.774365 30046 heartbeater.cc:503] Master 127.22.49.254:37869 was elected leader, sending a full tablet report...
I20260811 05:03:50.776309 30360 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:03:50.778456 30476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:50.779891 30360 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:50.780017 30360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "c8189bebb83a4d8faba846c71da5a898"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "5ec9b2864e9818e104be1987a2e819ea"
server_key_iv: "d105f83a7b4efe87a68b9776851dae51"
server_key_version: "encryptionkey@0"
I20260811 05:03:50.780594 30360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:50.805408 30360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:50.809813 30360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:50.810091 30360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:50.810876 30360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:50.811980 30360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:50.812064 30360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:50.812150 30360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:50.812197 30360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:50.824378 30360 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:39001
I20260811 05:03:50.824473 30603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:39001 every 8 connection(s)
I20260811 05:03:50.825573 30360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:03:50.829113 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 30360
I20260811 05:03:50.829314 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 29752
I20260811 05:03:50.846487 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:43167
--local_ip_for_outbound_sockets=127.22.49.194
--tserver_master_addrs=127.22.49.254:37869
--webserver_port=38143
--webserver_interface=127.22.49.194
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.194.keytab
--principal=oryx/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.22.49.254:37869,127.22.49.253:40519
--tserver_master_addrs=127.22.49.254:37869,127.22.49.253:40519,127.22.49.252:42483 with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424630, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.253@KRBTEST.COM
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424630, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.252@KRBTEST.COM
I20260811 05:03:50.854676 30335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.828392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:39055 (local address 127.22.49.253:40519)
0811 05:03:50.828532 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.828536 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.838073 (+ 9537us) server_negotiation.cc:407] Connection header received
0811 05:03:50.838232 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.838236 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.838296 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.838361 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.841015 (+ 2654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.841945 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.844480 (+ 2535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.844844 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.844942 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.849191 (+ 4249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.849195 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.849198 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.849232 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.851641 (+ 2409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.852378 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.852385 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.852389 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.852481 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.852940 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.852943 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.852946 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.853460 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.853541 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.854364 (+ 823us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.854502 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 05:03:50.854681 30608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.827628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:48115 (local address 127.22.49.252:42483)
0811 05:03:50.828029 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.828035 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.838629 (+ 10594us) server_negotiation.cc:407] Connection header received
0811 05:03:50.838688 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.838691 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.838751 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.838850 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.841036 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.842230 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.844480 (+ 2250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.844884 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.844960 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.849595 (+ 4635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.849600 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.849604 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.849639 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.852170 (+ 2531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.852729 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.852733 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.852734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.852822 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.853134 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.853138 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.853141 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.853400 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.853493 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.854375 (+ 882us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.854504 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":96,"threads_started":1}
I20260811 05:03:50.856493 30609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.828077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:40519 (local address 127.22.49.193:39055)
0811 05:03:50.837942 (+ 9865us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.837955 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.838096 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.838627 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.838638 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.839667 (+ 1029us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.840782 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.840810 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.842156 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.842160 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.844300 (+ 2140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.844313 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.845192 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.845196 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.845806 (+ 610us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.846512 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.846537 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.848958 (+ 2421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.851793 (+ 2835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.851800 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.851821 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.852240 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.852608 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.852610 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.852612 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.852814 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.853589 (+ 775us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.853591 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.854048 (+ 457us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.855434 (+ 1386us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.855570 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"mutex_wait_us":701,"spinlock_wait_cycles":14720,"thread_start_us":738,"threads_started":1}
I20260811 05:03:50.856493 30611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.828172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:42483 (local address 127.22.49.193:48115)
0811 05:03:50.838383 (+ 10211us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.838399 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.838527 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.839048 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.839052 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.840161 (+ 1109us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.840782 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.840810 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.842381 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.842385 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.844300 (+ 1915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.844313 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.845192 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.845196 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.845602 (+ 406us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.846496 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.846522 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.849391 (+ 2869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.852309 (+ 2918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.852315 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.852320 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.852613 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.852936 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.852939 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.852940 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.853027 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.853573 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.853582 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.854048 (+ 466us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.854855 (+ 807us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.855292 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10103,"mutex_wait_us":654,"spinlock_wait_cycles":6272,"thread_start_us":130,"threads_started":1}
I20260811 05:03:50.858152 30604 heartbeater.cc:347] Connected to a master server at 127.22.49.252:42483
I20260811 05:03:50.858196 30606 heartbeater.cc:347] Connected to a master server at 127.22.49.253:40519
I20260811 05:03:50.858429 30604 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:50.858428 30606 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:50.859057 30604 heartbeater.cc:511] Master 127.22.49.252:42483 requested a full tablet report, sending...
I20260811 05:03:50.859069 30606 heartbeater.cc:511] Master 127.22.49.253:40519 requested a full tablet report, sending...
I20260811 05:03:50.860694 30200 ts_manager.cc:194] Registered new tserver with Master: c8189bebb83a4d8faba846c71da5a898 (127.22.49.193:39001)
I20260811 05:03:50.860723 30404 ts_manager.cc:194] Registered new tserver with Master: c8189bebb83a4d8faba846c71da5a898 (127.22.49.193:39001)
Aug 11 05:03:50 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424630, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
I20260811 05:03:50.868110 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.827730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:60103 (local address 127.22.49.254:37869)
0811 05:03:50.827875 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:50.827880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:50.836868 (+ 8988us) server_negotiation.cc:407] Connection header received
0811 05:03:50.837899 (+ 1031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:50.837904 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:50.837994 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:50.838132 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:50.841001 (+ 2869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.841939 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.850730 (+ 8791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.851175 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.851293 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.863925 (+ 12632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:50.863930 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:50.863934 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:50.863981 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:50.865970 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.866579 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.866583 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.866585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.866687 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:50.867132 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:50.867136 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:50.867137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:50.867382 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:50.867534 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:50.867862 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 05:03:50.867982 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 05:03:50.868170 30610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:50.828077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.193:60103)
0811 05:03:50.836527 (+ 8450us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:50.836620 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:50.837632 (+ 1012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:50.838636 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:50.838644 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:50.839726 (+ 1082us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:50.840793 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.840812 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.842159 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.842166 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.850571 (+ 8405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:50.850583 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:50.852821 (+ 2238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:50.852825 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:50.852950 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:50.859257 (+ 6307us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:50.859272 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:50.863674 (+ 4402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:50.866156 (+ 2482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.866160 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.866162 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.866425 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.866807 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:50.866811 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:50.866813 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:50.866930 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:50.867544 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:50.867547 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:50.867672 (+ 125us) client_negotiation.cc:769] Sending connection context
0811 05:03:50.867782 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 05:03:50.867967 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8285,"mutex_wait_us":494,"spinlock_wait_cycles":2816,"thread_start_us":159,"threads_started":1}
I20260811 05:03:50.869050 30605 heartbeater.cc:347] Connected to a master server at 127.22.49.254:37869
I20260811 05:03:50.869186 30605 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:50.869421 30605 heartbeater.cc:511] Master 127.22.49.254:37869 requested a full tablet report, sending...
I20260811 05:03:50.870297 29531 ts_manager.cc:194] Re-registered known tserver with Master: c8189bebb83a4d8faba846c71da5a898 (127.22.49.193:39001)
I20260811 05:03:50.870894 29531 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:60103
W20260811 05:03:50.979745 30612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:50.980114 30612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:50.980206 30612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:50.984671 30612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:50.984781 30612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:50.984915 30612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:03:50.990924 30612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.194.keytab
--principal=oryx/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:43167
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=38143
--tserver_master_addrs=127.22.49.254:37869,127.22.49.253:40519,127.22.49.252:42483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:50.992249 30612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:50.993382 30612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:51.004344 30619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:51.004346 30618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:51.004346 30623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:51.004508 30612 server_base.cc:1034] running on GCE node
I20260811 05:03:51.005239 30612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:51.006047 30612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:51.007256 30612 hybrid_clock.cc:648] HybridClock initialized: now 1786424631007220 us; error 48 us; skew 500 ppm
Aug 11 05:03:51 dist-test-slave-w206 krb5kdc[29484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424631, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:51.010309 30612 init.cc:377] Logged in from keytab as oryx/127.22.49.194@KRBTEST.COM (short username oryx)
I20260811 05:03:51.011354 30612 webserver.cc:460] Webserver started at http://127.22.49.194:38143/ using document root <none> and password file <none>
I20260811 05:03:51.011979 30612 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:51.012089 30612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:51.016399 30612 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:03:51.019119 30630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:51.020517 30612 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:03:51.020668 30612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "2ad31a850b0e427bbb551eb9dea8d44c"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "1f6328c4a67a6c48fe64d2e9773b24f1"
server_key_iv: "131d4194978a7f3505740fe869e8c521"
server_key_version: "encryptionkey@0"
I20260811 05:03:51.021270 30612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:51.033131 30612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:51.036981 30612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:51.037236 30612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:51.037899 30612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:51.038833 30612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:51.038880 30612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:51.038923 30612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:51.038996 30612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:51.044451 30608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.040077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50330 (local address 127.22.49.252:42483)
0811 05:03:51.040284 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.040288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.040301 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:03:51.040350 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.040352 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.040402 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.040507 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:51.040770 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.041414 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.043100 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.043754 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.043874 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.044078 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.044194 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.044284 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 05:03:51.044463 30155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.039876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:42483 (local address 127.0.0.1:50330)
0811 05:03:51.040035 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:51.040055 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:51.040162 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:51.040519 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:51.040522 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:51.040540 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:51.040649 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.040655 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.041561 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.041565 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.042930 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.042946 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.043905 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.043918 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.044035 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.044079 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 05:03:51.044162 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 05:03:51.044280 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 05:03:51.045382 30415 raft_consensus.cc:1203] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 05:03:51.045822 30446 sys_catalog.cc:455] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d80c19eca274dce9243bf1c8b6b1c8a. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } } }
I20260811 05:03:51.045969 30446 sys_catalog.cc:458] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [sys.catalog]: This master's current role is: LEARNER
I20260811 05:03:51.049733 30612 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:43167
I20260811 05:03:51.049757 30756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:43167 every 8 connection(s)
I20260811 05:03:51.050872 30612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:03:51.056878 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 30612
I20260811 05:03:51.057112 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 29903
Aug 11 05:03:51 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424631, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.252@KRBTEST.COM
Aug 11 05:03:51 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424631, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.253@KRBTEST.COM
I20260811 05:03:51.069770 30608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.053645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:44695 (local address 127.22.49.252:42483)
0811 05:03:51.053760 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.053765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.054808 (+ 1043us) server_negotiation.cc:407] Connection header received
0811 05:03:51.055916 (+ 1108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.055919 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.055974 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.056063 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:51.057484 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.058213 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.060085 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.060454 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.060543 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.064678 (+ 4135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:51.064682 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:51.064685 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:51.064716 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:51.066687 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.067594 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.067598 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.067599 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.067707 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.068153 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.068156 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.068158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.068614 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:51.068729 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.069457 (+ 728us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.069593 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 05:03:51.069770 30335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.054345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:47883 (local address 127.22.49.253:40519)
0811 05:03:51.054466 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.054469 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.054480 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:03:51.055625 (+ 1145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.055631 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.055689 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.055783 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:51.058604 (+ 2821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.059421 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.060597 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.060914 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.061004 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.064678 (+ 3674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:51.064682 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:51.064685 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:51.064715 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:51.067028 (+ 2313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.067708 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.067712 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.067714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.067800 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.068149 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.068153 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.068155 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.068384 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:51.068453 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.069457 (+ 1004us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.069593 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 05:03:51 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424631, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
I20260811 05:03:51.071579 30764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.053250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:40519 (local address 127.22.49.194:47883)
0811 05:03:51.054067 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:51.054122 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:51.055241 (+ 1119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:51.055858 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:51.055868 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:51.056490 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:51.058444 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.058455 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.059569 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.059573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.060470 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.060480 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.061156 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.061161 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.061709 (+ 548us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.062211 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:51.062227 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:51.064459 (+ 2232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:51.067165 (+ 2706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:51.067276 (+ 111us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:51.067278 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:51.067598 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:51.067909 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:51.067912 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:51.067914 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:51.068038 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:51.068795 (+ 757us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:51.068798 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:51.069134 (+ 336us) client_negotiation.cc:769] Sending connection context
0811 05:03:51.070567 (+ 1433us) client_negotiation.cc:240] Negotiation successful
0811 05:03:51.070754 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"mutex_wait_us":1455,"spinlock_wait_cycles":55296,"thread_start_us":153,"threads_started":1}
I20260811 05:03:51.071868 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.053521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:42483 (local address 127.22.49.194:44695)
0811 05:03:51.054678 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:51.054691 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:51.055269 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:51.056093 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:51.056097 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:51.056490 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:51.057311 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.057334 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.058489 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.058495 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.059921 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.059931 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.060768 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.060771 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.060996 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.061716 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:51.061738 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:51.064459 (+ 2721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:51.066842 (+ 2383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:51.066851 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:51.066871 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:51.067433 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:51.067822 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:51.067828 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:51.067832 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:51.068046 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:51.068729 (+ 683us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:51.068737 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:51.069134 (+ 397us) client_negotiation.cc:769] Sending connection context
0811 05:03:51.069966 (+ 832us) client_negotiation.cc:240] Negotiation successful
0811 05:03:51.070381 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1101,"mutex_wait_us":147,"spinlock_wait_cycles":30336,"thread_start_us":80,"threads_started":1}
I20260811 05:03:51.073225 30760 heartbeater.cc:347] Connected to a master server at 127.22.49.253:40519
I20260811 05:03:51.073480 30760 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:51.074213 30760 heartbeater.cc:511] Master 127.22.49.253:40519 requested a full tablet report, sending...
I20260811 05:03:51.075254 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.052752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:36945 (local address 127.22.49.254:37869)
0811 05:03:51.052945 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.052950 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.054348 (+ 1398us) server_negotiation.cc:407] Connection header received
0811 05:03:51.055486 (+ 1138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.055489 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.055556 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.055631 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:51.058655 (+ 3024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.059816 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.061623 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.062128 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.062268 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.070805 (+ 8537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:51.070812 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:51.070818 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:51.070858 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:51.072893 (+ 2035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.073647 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.073651 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.073653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.073775 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.074109 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.074113 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.074114 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.074394 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:51.074505 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.074906 (+ 401us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.075086 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 05:03:51.075366 30765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.053250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.194:36945)
0811 05:03:51.054268 (+ 1018us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:51.054281 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:51.055241 (+ 960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:51.055858 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:51.055869 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:51.056465 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:51.058454 (+ 1989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.058470 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.060020 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.060027 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.061443 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.061459 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.062512 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.062520 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.062666 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.068850 (+ 6184us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:51.068871 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:51.070603 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:51.073095 (+ 2492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:51.073101 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:51.073106 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:51.073499 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:51.073882 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:51.073888 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:51.073893 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:51.073999 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:51.074496 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:51.074501 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:51.074665 (+ 164us) client_negotiation.cc:769] Sending connection context
0811 05:03:51.074844 (+ 179us) client_negotiation.cc:240] Negotiation successful
0811 05:03:51.075059 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":943,"mutex_wait_us":260,"spinlock_wait_cycles":34944,"thread_start_us":130,"threads_started":1}
I20260811 05:03:51.075850 30200 ts_manager.cc:194] Registered new tserver with Master: 2ad31a850b0e427bbb551eb9dea8d44c (127.22.49.194:43167)
I20260811 05:03:51.076577 30757 heartbeater.cc:347] Connected to a master server at 127.22.49.252:42483
I20260811 05:03:51.076654 30757 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:51.076809 30758 heartbeater.cc:347] Connected to a master server at 127.22.49.254:37869
I20260811 05:03:51.076944 30758 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:51.076822 30757 heartbeater.cc:511] Master 127.22.49.252:42483 requested a full tablet report, sending...
I20260811 05:03:51.077124 30758 heartbeater.cc:511] Master 127.22.49.254:37869 requested a full tablet report, sending...
I20260811 05:03:51.077770 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:39195
--local_ip_for_outbound_sockets=127.22.49.195
--tserver_master_addrs=127.22.49.254:37869
--webserver_port=34233
--webserver_interface=127.22.49.195
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.195.keytab
--principal=oryx/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.22.49.254:37869,127.22.49.253:40519
--tserver_master_addrs=127.22.49.254:37869,127.22.49.253:40519,127.22.49.252:42483 with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:03:51.077776 29531 ts_manager.cc:194] Re-registered known tserver with Master: 2ad31a850b0e427bbb551eb9dea8d44c (127.22.49.194:43167)
I20260811 05:03:51.078402 29531 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:36945
I20260811 05:03:51.079799 30404 ts_manager.cc:194] Registered new tserver with Master: 2ad31a850b0e427bbb551eb9dea8d44c (127.22.49.194:43167)
W20260811 05:03:51.203850 30767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:51.204139 30767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:51.204185 30767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:51.208684 30767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:51.208797 30767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:51.208882 30767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:03:51.214751 30767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.195.keytab
--principal=oryx/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:39195
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=34233
--tserver_master_addrs=127.22.49.254:37869,127.22.49.253:40519,127.22.49.252:42483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:51.216045 30767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:51.217259 30767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:51.228374 30772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:51.228401 30773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:51.228385 30775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:51.229256 30767 server_base.cc:1034] running on GCE node
I20260811 05:03:51.229758 30767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:51.230532 30767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:51.231742 30767 hybrid_clock.cc:648] HybridClock initialized: now 1786424631231718 us; error 39 us; skew 500 ppm
Aug 11 05:03:51 dist-test-slave-w206 krb5kdc[29484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424631, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:51.241045 30767 init.cc:377] Logged in from keytab as oryx/127.22.49.195@KRBTEST.COM (short username oryx)
I20260811 05:03:51.242226 30767 webserver.cc:460] Webserver started at http://127.22.49.195:34233/ using document root <none> and password file <none>
I20260811 05:03:51.243026 30767 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:51.243199 30767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:51.248008 30767 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 05:03:51.250367 30783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:51.251755 30767 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:51.251928 30767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "6d636ca1a3ab4bf99b43459f0821e1b7"
format_stamp: "Formatted at 2026-08-11 05:03:49 on dist-test-slave-w206"
server_key: "f4c7218ddfa1f99237c3332eda50dd9b"
server_key_iv: "1e8d607f45010c31797f5b38c9b97f2d"
server_key_version: "encryptionkey@0"
I20260811 05:03:51.252537 30767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:51.270776 30767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:51.274572 30767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:51.274747 30767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:51.275454 30767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:03:51.276418 30767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:51.276467 30767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:51.276508 30767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:51.276525 30767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:51.286192 30767 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:39195
I20260811 05:03:51.286244 30913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:39195 every 8 connection(s)
I20260811 05:03:51.287572 30767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:03:51.296770 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 30767
Aug 11 05:03:51 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424631, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.252@KRBTEST.COM
Aug 11 05:03:51 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424631, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.253@KRBTEST.COM
I20260811 05:03:51.305932 30335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.292203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:38463 (local address 127.22.49.253:40519)
0811 05:03:51.292343 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.292348 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.292365 (+ 17us) server_negotiation.cc:407] Connection header received
0811 05:03:51.292543 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.292546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.292607 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.292656 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:51.294561 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.295429 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.297317 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.297678 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.297748 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.301647 (+ 3899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:51.301651 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:51.301654 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:51.301682 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:51.303481 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.304020 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.304025 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.304026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.304125 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.304499 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.304502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.304504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.304744 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:51.304814 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.305583 (+ 769us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.305727 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 05:03:51.306198 30608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.289551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:37131 (local address 127.22.49.252:42483)
0811 05:03:51.289705 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.289709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.291194 (+ 1485us) server_negotiation.cc:407] Connection header received
0811 05:03:51.292806 (+ 1612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.292810 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.292866 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.292925 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:51.294568 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.295434 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.297392 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.297756 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.297860 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.301355 (+ 3495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:51.301360 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:51.301363 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:51.301395 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:51.303256 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.303940 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.303944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.303946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.304049 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.304490 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.304493 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.304494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.304734 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:51.304831 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.305561 (+ 730us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.306035 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 05:03:51.307945 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.291277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:40519 (local address 127.22.49.195:38463)
0811 05:03:51.291596 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:51.291611 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:51.292392 (+ 781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:51.292979 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:51.292987 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:51.293584 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:51.294380 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.294401 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.295616 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.295619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.297174 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.297185 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.297967 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.297970 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.298165 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.298964 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:51.299013 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:51.301469 (+ 2456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:51.303613 (+ 2144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:51.303617 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:51.303619 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:51.303892 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:51.304245 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:51.304248 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:51.304250 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:51.304383 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:51.304890 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:51.304898 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:51.305268 (+ 370us) client_negotiation.cc:769] Sending connection context
0811 05:03:51.306191 (+ 923us) client_negotiation.cc:240] Negotiation successful
0811 05:03:51.306765 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":380,"spinlock_wait_cycles":59136,"thread_start_us":146,"threads_started":1}
Aug 11 05:03:51 dist-test-slave-w206 krb5kdc[29484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424631, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
I20260811 05:03:51.308267 30919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.289939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:42483 (local address 127.22.49.195:37131)
0811 05:03:51.290951 (+ 1012us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:51.291063 (+ 112us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:51.292263 (+ 1200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:51.293056 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:51.293059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:51.293613 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:51.294385 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.294401 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.295677 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.295680 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.297223 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.297236 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.298048 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.298051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.298179 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.299055 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:51.299072 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:51.301099 (+ 2027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:51.303399 (+ 2300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:51.303406 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:51.303426 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:51.303798 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:51.304157 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:51.304161 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:51.304163 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:51.304381 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:51.304920 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:51.304927 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:51.305266 (+ 339us) client_negotiation.cc:769] Sending connection context
0811 05:03:51.306425 (+ 1159us) client_negotiation.cc:240] Negotiation successful
0811 05:03:51.306645 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":797,"mutex_wait_us":388,"spinlock_wait_cycles":30208,"thread_start_us":623,"threads_started":1}
I20260811 05:03:51.309757 30917 heartbeater.cc:347] Connected to a master server at 127.22.49.253:40519
I20260811 05:03:51.309854 30915 heartbeater.cc:347] Connected to a master server at 127.22.49.252:42483
I20260811 05:03:51.310034 30915 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:51.310747 30915 heartbeater.cc:511] Master 127.22.49.252:42483 requested a full tablet report, sending...
I20260811 05:03:51.310034 30917 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:51.311299 30917 heartbeater.cc:511] Master 127.22.49.253:40519 requested a full tablet report, sending...
I20260811 05:03:51.312160 30200 ts_manager.cc:194] Registered new tserver with Master: 6d636ca1a3ab4bf99b43459f0821e1b7 (127.22.49.195:39195)
I20260811 05:03:51.312180 30404 ts_manager.cc:194] Registered new tserver with Master: 6d636ca1a3ab4bf99b43459f0821e1b7 (127.22.49.195:39195)
I20260811 05:03:51.313385 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.291731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.195:51089)
0811 05:03:51.292036 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:51.292051 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:51.292530 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:51.292977 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:51.292989 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:51.293617 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:51.294384 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.294401 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.295623 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.295654 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.304576 (+ 8922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.304586 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.305355 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.305359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.305465 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.306050 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:51.306068 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:51.309026 (+ 2958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:51.311606 (+ 2580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:51.311612 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:51.311618 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:51.311911 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:51.312250 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:51.312253 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:51.312255 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:51.312346 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:51.312848 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:51.312851 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:51.312948 (+ 97us) client_negotiation.cc:769] Sending connection context
0811 05:03:51.313056 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 05:03:51.313194 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"mutex_wait_us":254,"spinlock_wait_cycles":29440,"thread_start_us":120,"threads_started":1}
I20260811 05:03:51.313558 29579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.292355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:51089 (local address 127.22.49.254:37869)
0811 05:03:51.292496 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.292503 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.292518 (+ 15us) server_negotiation.cc:407] Connection header received
0811 05:03:51.292667 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.292670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.292724 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.292798 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:51.294568 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.295434 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.304727 (+ 9293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.305086 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.305174 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.309226 (+ 4052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:51.309230 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:51.309233 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:51.309266 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:51.311477 (+ 2211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.312032 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.312035 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.312037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.312129 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.312460 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.312463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.312465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.312693 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:51.312766 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.313135 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.313276 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 05:03:51.314124 30916 heartbeater.cc:347] Connected to a master server at 127.22.49.254:37869
I20260811 05:03:51.314232 30916 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:51.314431 30916 heartbeater.cc:511] Master 127.22.49.254:37869 requested a full tablet report, sending...
I20260811 05:03:51.315189 29531 ts_manager.cc:194] Re-registered known tserver with Master: 6d636ca1a3ab4bf99b43459f0821e1b7 (127.22.49.195:39195)
I20260811 05:03:51.315999 29531 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:51089
I20260811 05:03:51.318029 30929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.301457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50334 (local address 127.22.49.252:42483)
0811 05:03:51.303035 (+ 1578us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.303041 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.304183 (+ 1142us) server_negotiation.cc:407] Connection header received
0811 05:03:51.304220 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.304223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.304268 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.304361 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:51.305432 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.306747 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.307990 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.308819 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.308931 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.313885 (+ 4954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:51.313890 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:51.313893 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:51.313923 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:51.315938 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.316465 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.316469 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.316470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.316621 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.316941 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.316944 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.316946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.317166 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:51.317326 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.317679 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.317825 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1442,"thread_start_us":98,"threads_started":1}
I20260811 05:03:51.320091 30928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.299764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49544 (local address 127.22.49.254:37869)
0811 05:03:51.300083 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.300090 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.305963 (+ 5873us) server_negotiation.cc:407] Connection header received
0811 05:03:51.307680 (+ 1717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.307683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.307739 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.307804 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:51.309711 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.310421 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.311638 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.311961 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.312036 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.314898 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:51.314901 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:51.314904 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:51.314930 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:51.317177 (+ 2247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.318278 (+ 1101us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.318281 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.318283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.318378 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.319041 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.319044 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.319046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.319299 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:51.319448 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.319701 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.319818 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":126,"threads_started":1}
I20260811 05:03:51.323880 30931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.302884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34138 (local address 127.22.49.253:40519)
0811 05:03:51.303531 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.303547 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.309484 (+ 5937us) server_negotiation.cc:407] Connection header received
0811 05:03:51.309588 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.309591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.309651 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.309745 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:51.315736 (+ 5991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.316637 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.318246 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.318605 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.318748 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.320272 (+ 1524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:51.320275 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:51.320278 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:51.320307 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:51.322139 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.322577 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.322580 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.322582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.322676 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.322958 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.322961 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.322963 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.323216 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:51.323353 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.323579 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.323708 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":123,"threads_started":1}
I20260811 05:03:51.323091 29531 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49544:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:03:51.326894 29531 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:51.329706 30364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: NON_VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: true } } }
I20260811 05:03:51.329891 30364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:51.333891 30938 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a: attempting to promote NON_VOTER aca99b03ee8b418cae663dc5ffb91178 to VOTER
I20260811 05:03:51.334233 30938 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } }
I20260811 05:03:51.335448 30415 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 1 LEARNER]: Refusing update from remote peer 1d80c19eca274dce9243bf1c8b6b1c8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 05:03:51.335870 30364 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 05:03:51.336709 30211 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 FOLLOWER]: Refusing update from remote peer 1d80c19eca274dce9243bf1c8b6b1c8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 05:03:51.337296 30939 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 05:03:51.337699 30937 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, aca99b03ee8b418cae663dc5ffb91178 (127.22.49.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } } }
I20260811 05:03:51.338475 30211 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, aca99b03ee8b418cae663dc5ffb91178 (127.22.49.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } } }
I20260811 05:03:51.338289 30415 raft_consensus.cc:2932] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, aca99b03ee8b418cae663dc5ffb91178 (127.22.49.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } } }
I20260811 05:03:51.339438 30937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } } }
I20260811 05:03:51.339552 30937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:51.339699 30937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } } }
I20260811 05:03:51.339789 30937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:51.340487 30947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } } }
I20260811 05:03:51.340525 30446 sys_catalog.cc:455] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } } }
I20260811 05:03:51.340616 30947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:03:51.340643 30446 sys_catalog.cc:458] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:03:51.341015 30364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } } }
I20260811 05:03:51.341126 30364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:51.350500 30155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.344226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:39001 (local address 127.0.0.1:39780)
0811 05:03:51.344389 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:51.344407 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:51.344502 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:51.345777 (+ 1275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:51.345780 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:51.345796 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:51.345909 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.345915 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.348115 (+ 2200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.348118 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.349196 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.349206 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.350103 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.350107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.350186 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.350208 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 05:03:51.350270 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 05:03:51.350351 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65,"mutex_wait_us":27}
I20260811 05:03:51.350591 30950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.344815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39780 (local address 127.22.49.193:39001)
0811 05:03:51.345219 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.345250 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.345279 (+ 29us) server_negotiation.cc:407] Connection header received
0811 05:03:51.345371 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.345377 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.345635 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.345820 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:51.346730 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.347984 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.349314 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.349970 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.350103 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.350292 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.350347 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.350444 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":68,"threads_started":1}
I20260811 05:03:51.351084 30948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.344868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:39195 (local address 127.0.0.1:59826)
0811 05:03:51.345704 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:51.345721 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:51.346135 (+ 414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:51.346733 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:51.346736 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:51.346767 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:51.346861 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.346867 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.348295 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.348298 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.349374 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.349384 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.350622 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.350627 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.350740 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.350762 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 05:03:51.350846 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 05:03:51.350918 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":771,"mutex_wait_us":22,"thread_start_us":102,"threads_started":1}
I20260811 05:03:51.351178 30952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.345167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59826 (local address 127.22.49.195:39195)
0811 05:03:51.345550 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.345560 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.346067 (+ 507us) server_negotiation.cc:407] Connection header received
0811 05:03:51.346273 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.346278 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.346439 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.346562 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:51.347099 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.348177 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.349503 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.350322 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.350420 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.350552 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.350889 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.351027 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":100,"threads_started":1}
I20260811 05:03:51.352356 30951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.344507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:43167 (local address 127.0.0.1:52336)
0811 05:03:51.345125 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:51.345140 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:51.345234 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:51.346590 (+ 1356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:51.346593 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:51.346611 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:51.346714 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.346721 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.347904 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.347908 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.350057 (+ 2149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.350067 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.351966 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.351969 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.352058 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.352080 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 05:03:51.352149 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 05:03:51.352219 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"mutex_wait_us":58,"thread_start_us":143,"threads_started":1}
I20260811 05:03:51.352866 30949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.344718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52336 (local address 127.22.49.194:43167)
0811 05:03:51.346125 (+ 1407us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.346136 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.346157 (+ 21us) server_negotiation.cc:407] Connection header received
0811 05:03:51.346237 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.346254 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.346438 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.346579 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:51.346865 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.347768 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.350207 (+ 2439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.351661 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.351767 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.351901 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.352627 (+ 726us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.352732 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1297,"thread_start_us":117,"threads_started":1}
I20260811 05:03:51.353889 30528 tablet_service.cc:1467] Processing CreateTablet for tablet 69fea35edffb487592cb8fcfea0b319c (DEFAULT_TABLE table=test-table [id=480387e2cda24c56b2d3a4c48e4ecc84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:51.354311 30834 tablet_service.cc:1467] Processing CreateTablet for tablet 69fea35edffb487592cb8fcfea0b319c (DEFAULT_TABLE table=test-table [id=480387e2cda24c56b2d3a4c48e4ecc84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:51.354960 30528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69fea35edffb487592cb8fcfea0b319c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:51.355358 30834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69fea35edffb487592cb8fcfea0b319c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:51.355698 30684 tablet_service.cc:1467] Processing CreateTablet for tablet 69fea35edffb487592cb8fcfea0b319c (DEFAULT_TABLE table=test-table [id=480387e2cda24c56b2d3a4c48e4ecc84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:51.356716 30684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69fea35edffb487592cb8fcfea0b319c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:51.363322 30953 tablet_bootstrap.cc:492] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898: Bootstrap starting.
I20260811 05:03:51.365700 30953 tablet_bootstrap.cc:654] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:51.366400 30955 tablet_bootstrap.cc:492] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c: Bootstrap starting.
I20260811 05:03:51.366676 30953 log.cc:824] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:51.367403 30954 tablet_bootstrap.cc:492] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7: Bootstrap starting.
I20260811 05:03:51.369254 30953 tablet_bootstrap.cc:492] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898: No bootstrap required, opened a new log
I20260811 05:03:51.369238 30955 tablet_bootstrap.cc:654] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:51.369486 30953 ts_tablet_manager.cc:1397] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 05:03:51.369683 30954 tablet_bootstrap.cc:654] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:51.370154 30955 log.cc:824] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:51.370440 30954 log.cc:824] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:51.372294 30955 tablet_bootstrap.cc:492] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c: No bootstrap required, opened a new log
I20260811 05:03:51.372514 30955 ts_tablet_manager.cc:1397] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 05:03:51.373114 30953 raft_consensus.cc:348] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } }
I20260811 05:03:51.373466 30953 raft_consensus.cc:374] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:51.373528 30953 raft_consensus.cc:729] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8189bebb83a4d8faba846c71da5a898, State: Initialized, Role: FOLLOWER
I20260811 05:03:51.374011 30953 consensus_queue.cc:260] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } }
I20260811 05:03:51.374143 30954 tablet_bootstrap.cc:492] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7: No bootstrap required, opened a new log
I20260811 05:03:51.374470 30954 ts_tablet_manager.cc:1397] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 05:03:51.375231 30953 ts_tablet_manager.cc:1428] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 05:03:51.375679 30605 heartbeater.cc:503] Master 127.22.49.254:37869 was elected leader, sending a full tablet report...
I20260811 05:03:51.377514 30955 raft_consensus.cc:348] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } }
I20260811 05:03:51.377789 30955 raft_consensus.cc:374] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:51.377851 30955 raft_consensus.cc:729] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ad31a850b0e427bbb551eb9dea8d44c, State: Initialized, Role: FOLLOWER
I20260811 05:03:51.378371 30955 consensus_queue.cc:260] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } }
I20260811 05:03:51.379777 30955 ts_tablet_manager.cc:1428] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 05:03:51.379832 30954 raft_consensus.cc:348] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } }
I20260811 05:03:51.380134 30954 raft_consensus.cc:374] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:51.380182 30758 heartbeater.cc:503] Master 127.22.49.254:37869 was elected leader, sending a full tablet report...
I20260811 05:03:51.380198 30954 raft_consensus.cc:729] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d636ca1a3ab4bf99b43459f0821e1b7, State: Initialized, Role: FOLLOWER
I20260811 05:03:51.380684 30954 consensus_queue.cc:260] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } }
I20260811 05:03:51.382083 30954 ts_tablet_manager.cc:1428] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260811 05:03:51.383901 30916 heartbeater.cc:503] Master 127.22.49.254:37869 was elected leader, sending a full tablet report...
I20260811 05:03:51.427914 30959 raft_consensus.cc:482] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:51.428161 30959 raft_consensus.cc:504] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } }
I20260811 05:03:51.429363 30959 leader_election.cc:288] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ad31a850b0e427bbb551eb9dea8d44c (127.22.49.194:43167), 6d636ca1a3ab4bf99b43459f0821e1b7 (127.22.49.195:39195)
I20260811 05:03:51.434044 30952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.429776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:38823 (local address 127.22.49.195:39195)
0811 05:03:51.429929 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.429934 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.430500 (+ 566us) server_negotiation.cc:407] Connection header received
0811 05:03:51.430570 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.430573 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.430623 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.430715 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:51.431047 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.431667 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.432847 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.433333 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.433465 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.433523 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.433817 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.433905 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 05:03:51.434077 30962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.429673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:39195 (local address 127.22.49.193:38823)
0811 05:03:51.430297 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:51.430314 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:51.430490 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:51.430732 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:51.430734 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:51.430748 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:51.430875 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.430882 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.431785 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.431788 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.432692 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.432703 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.433518 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.433522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.433656 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.433692 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 05:03:51.433785 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 05:03:51.433885 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"mutex_wait_us":70,"thread_start_us":142,"threads_started":1}
I20260811 05:03:51.434100 30963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.429673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:43167 (local address 127.22.49.193:53103)
0811 05:03:51.430118 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:51.430133 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:51.430256 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:51.430553 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:51.430556 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:51.430577 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:51.430732 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.430740 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.431573 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.431576 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.432688 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:51.432699 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.433605 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.433608 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:51.433748 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.433767 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 05:03:51.433868 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 05:03:51.433944 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":29,"thread_start_us":152,"threads_started":1}
I20260811 05:03:51.434084 30949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.429776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:53103 (local address 127.22.49.194:43167)
0811 05:03:51.429930 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.429935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.430259 (+ 324us) server_negotiation.cc:407] Connection header received
0811 05:03:51.430352 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.430356 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.430427 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.430511 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:51.430865 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.431449 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.432820 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.433429 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.433554 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.433615 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.433889 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.433976 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 05:03:51.434775 30858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69fea35edffb487592cb8fcfea0b319c" candidate_uuid: "c8189bebb83a4d8faba846c71da5a898" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" is_pre_election: true
I20260811 05:03:51.434770 30707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69fea35edffb487592cb8fcfea0b319c" candidate_uuid: "c8189bebb83a4d8faba846c71da5a898" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" is_pre_election: true
I20260811 05:03:51.435148 30858 raft_consensus.cc:2454] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8189bebb83a4d8faba846c71da5a898 in term 0.
I20260811 05:03:51.435148 30707 raft_consensus.cc:2454] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8189bebb83a4d8faba846c71da5a898 in term 0.
I20260811 05:03:51.435736 30479 leader_election.cc:302] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2ad31a850b0e427bbb551eb9dea8d44c, 6d636ca1a3ab4bf99b43459f0821e1b7, c8189bebb83a4d8faba846c71da5a898; no voters:
I20260811 05:03:51.436159 30959 raft_consensus.cc:2781] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:51.436275 30959 raft_consensus.cc:482] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:51.436321 30959 raft_consensus.cc:3037] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:51.437592 30959 raft_consensus.cc:504] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } }
I20260811 05:03:51.438002 30959 leader_election.cc:288] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [CANDIDATE]: Term 1 election: Requested vote from peers 2ad31a850b0e427bbb551eb9dea8d44c (127.22.49.194:43167), 6d636ca1a3ab4bf99b43459f0821e1b7 (127.22.49.195:39195)
I20260811 05:03:51.438418 30707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69fea35edffb487592cb8fcfea0b319c" candidate_uuid: "c8189bebb83a4d8faba846c71da5a898" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad31a850b0e427bbb551eb9dea8d44c"
I20260811 05:03:51.438606 30858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69fea35edffb487592cb8fcfea0b319c" candidate_uuid: "c8189bebb83a4d8faba846c71da5a898" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7"
I20260811 05:03:51.438679 30707 raft_consensus.cc:3037] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:51.438794 30858 raft_consensus.cc:3037] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:51.439994 30858 raft_consensus.cc:2454] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8189bebb83a4d8faba846c71da5a898 in term 1.
I20260811 05:03:51.439998 30707 raft_consensus.cc:2454] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8189bebb83a4d8faba846c71da5a898 in term 1.
I20260811 05:03:51.440374 30477 leader_election.cc:302] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ad31a850b0e427bbb551eb9dea8d44c, c8189bebb83a4d8faba846c71da5a898; no voters:
I20260811 05:03:51.440573 30959 raft_consensus.cc:2781] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:51.440896 30959 raft_consensus.cc:686] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [term 1 LEADER]: Becoming Leader. State: Replica: c8189bebb83a4d8faba846c71da5a898, State: Running, Role: LEADER
I20260811 05:03:51.441322 30959 consensus_queue.cc:237] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } }
I20260811 05:03:51.446457 29532 catalog_manager.cc:5495] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8189bebb83a4d8faba846c71da5a898 (127.22.49.193). New cstate: current_term: 1 leader_uuid: "c8189bebb83a4d8faba846c71da5a898" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } health_report { overall_health: UNKNOWN } } }
I20260811 05:03:51.462085 30950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.458224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39788 (local address 127.22.49.193:39001)
0811 05:03:51.458366 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.458371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.458392 (+ 21us) server_negotiation.cc:407] Connection header received
0811 05:03:51.458516 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.458518 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.458578 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.458697 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:51.459023 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.459579 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.460475 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.460716 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.460811 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.461143 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:51.461660 (+ 517us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:51.461759 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.461883 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.461960 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:03:51.469092 30707 raft_consensus.cc:1261] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c [term 1 FOLLOWER]: Refusing update from remote peer c8189bebb83a4d8faba846c71da5a898: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:51.469092 30858 raft_consensus.cc:1261] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 1 FOLLOWER]: Refusing update from remote peer c8189bebb83a4d8faba846c71da5a898: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:51.470052 30964 consensus_queue.cc:1035] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:51.470320 30959 consensus_queue.cc:1035] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:51.479372 30967 mvcc.cc:205] Tried to move back new op lower bound from 7317195290487803904 to 7317195290387177472. Current Snapshot: MvccSnapshot[applied={T|T < 7317195290487803904}]
I20260811 05:03:51.482436 30968 mvcc.cc:205] Tried to move back new op lower bound from 7317195290487803904 to 7317195290387177472. Current Snapshot: MvccSnapshot[applied={T|T < 7317195290487803904}]
I20260811 05:03:51.485670 30969 mvcc.cc:205] Tried to move back new op lower bound from 7317195290487803904 to 7317195290387177472. Current Snapshot: MvccSnapshot[applied={T|T < 7317195290487803904}]
I20260811 05:03:51.494232 29533 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:51.494498 29533 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:51.501472 29533 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1d80c19eca274dce9243bf1c8b6b1c8a: Sending DeleteTablet for 3 replicas of tablet 69fea35edffb487592cb8fcfea0b319c
I20260811 05:03:51.502516 30684 tablet_service.cc:1514] Processing DeleteTablet for tablet 69fea35edffb487592cb8fcfea0b319c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:51 UTC) from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:52336
I20260811 05:03:51.502564 30528 tablet_service.cc:1514] Processing DeleteTablet for tablet 69fea35edffb487592cb8fcfea0b319c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:51 UTC) from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:39780
I20260811 05:03:51.503816 30834 tablet_service.cc:1514] Processing DeleteTablet for tablet 69fea35edffb487592cb8fcfea0b319c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:51 UTC) from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:59826
I20260811 05:03:51.503934 30977 tablet_replica.cc:330] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898: stopping tablet replica
I20260811 05:03:51.504508 30977 raft_consensus.cc:2229] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:03:51.505071 30977 raft_consensus.cc:2258] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:51.506179 30980 tablet_replica.cc:330] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7: stopping tablet replica
I20260811 05:03:51.506551 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 29497
I20260811 05:03:51.509044 30980 raft_consensus.cc:2229] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:51.509727 30980 raft_consensus.cc:2258] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:51.509867 30977 ts_tablet_manager.cc:1905] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:51.512293 30980 ts_tablet_manager.cc:1905] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:51.514258 30977 ts_tablet_manager.cc:1918] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:51.514479 30977 log.cc:1196] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-0/wal/wals/69fea35edffb487592cb8fcfea0b319c
I20260811 05:03:51.515026 30977 ts_tablet_manager.cc:1939] T 69fea35edffb487592cb8fcfea0b319c P c8189bebb83a4d8faba846c71da5a898: Deleting consensus metadata
I20260811 05:03:51.505589 30978 tablet_replica.cc:330] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c: stopping tablet replica
I20260811 05:03:51.515543 30978 raft_consensus.cc:2229] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:51.516069 30978 raft_consensus.cc:2258] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:51.516476 30980 ts_tablet_manager.cc:1918] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:51.516598 30980 log.cc:1196] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/69fea35edffb487592cb8fcfea0b319c
I20260811 05:03:51.517130 30980 ts_tablet_manager.cc:1939] T 69fea35edffb487592cb8fcfea0b319c P 6d636ca1a3ab4bf99b43459f0821e1b7: Deleting consensus metadata
W20260811 05:03:51.521281 30784 connection.cc:535] server connection from 127.0.0.1:59826 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 05:03:51.521713 30479 connection.cc:535] server connection from 127.0.0.1:39780 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 05:03:51.522151 30931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.504695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34140 (local address 127.22.49.253:40519)
0811 05:03:51.505038 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.505043 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.505867 (+ 824us) server_negotiation.cc:407] Connection header received
0811 05:03:51.505962 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.505968 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.506033 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.506135 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:51.509746 (+ 3611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.510660 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.512696 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.513122 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.513232 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.516602 (+ 3370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:51.516607 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:51.516630 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:51.516675 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:51.519039 (+ 2364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.519817 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.519822 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.519824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.520170 (+ 346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.520596 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.520600 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.520603 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.520887 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:51.521023 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.521777 (+ 754us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.521956 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240}
I20260811 05:03:51.522869 30978 ts_tablet_manager.cc:1905] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:51.525776 30978 ts_tablet_manager.cc:1918] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:51.525892 30978 log.cc:1196] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/69fea35edffb487592cb8fcfea0b319c
I20260811 05:03:51.526255 30978 ts_tablet_manager.cc:1939] T 69fea35edffb487592cb8fcfea0b319c P 2ad31a850b0e427bbb551eb9dea8d44c: Deleting consensus metadata
W20260811 05:03:51.527652 30632 connection.cc:441] server connection from 127.0.0.1:52336 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52336 (request call id 1) could send its response
I20260811 05:03:51.534910 30929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.505163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50340 (local address 127.22.49.252:42483)
0811 05:03:51.505288 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.505292 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.523835 (+ 18543us) server_negotiation.cc:407] Connection header received
0811 05:03:51.524032 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.524035 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.524096 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.524152 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:51.525108 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.525958 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.527350 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.527728 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.527808 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.530353 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:51.530359 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:51.530362 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:51.530392 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:51.532285 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.532829 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.532833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.532835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.532929 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.533233 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.533236 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.533238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.533765 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:51.533867 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.534226 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.534430 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 05:03:51.539098 30931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.528527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34142 (local address 127.22.49.253:40519)
0811 05:03:51.528647 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.528652 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.529055 (+ 403us) server_negotiation.cc:407] Connection header received
0811 05:03:51.529176 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.529179 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.529231 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.529312 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:51.530196 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.531061 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.532304 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.532823 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.532919 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.534900 (+ 1981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:51.534904 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:51.534908 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:51.534937 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:51.537016 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.537578 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.537581 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.537583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.537679 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.538047 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.538053 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.538057 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.538343 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:51.538493 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.538762 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.538900 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 05:03:51.539688 30608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:51.529532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50352 (local address 127.22.49.252:42483)
0811 05:03:51.529655 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:51.529659 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:51.530339 (+ 680us) server_negotiation.cc:407] Connection header received
0811 05:03:51.530495 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:51.530499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:51.530546 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:51.530602 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:51.531570 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.532394 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.533672 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:51.534002 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:51.534073 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:51.536007 (+ 1934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:51.536011 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:51.536013 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:51.536038 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:51.537613 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.538103 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.538107 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.538108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.538192 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:51.538509 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:51.538515 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:51.538516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:51.538751 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:51.538864 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:51.539403 (+ 539us) server_negotiation.cc:299] Negotiation successful
0811 05:03:51.539532 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:03:52.487222 30989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:52.486694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.194:60557)
0811 05:03:52.487017 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:52.487126 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":100,"threads_started":1}
I20260811 05:03:52.487311 30990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:52.486819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.195:41257)
0811 05:03:52.487112 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:52.487200 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":165,"threads_started":1}
W20260811 05:03:52.487586 30758 heartbeater.cc:644] Failed to heartbeat to 127.22.49.254:37869 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
W20260811 05:03:52.487593 30916 heartbeater.cc:644] Failed to heartbeat to 127.22.49.254:37869 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
I20260811 05:03:52.493618 30991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:52.493068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.193:57405)
0811 05:03:52.493387 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:52.493502 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":86,"threads_started":1}
W20260811 05:03:52.494237 30605 heartbeater.cc:644] Failed to heartbeat to 127.22.49.254:37869 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
I20260811 05:03:53.001739 30992 raft_consensus.cc:482] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d80c19eca274dce9243bf1c8b6b1c8a)
I20260811 05:03:53.001998 30992 raft_consensus.cc:504] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } }
I20260811 05:03:53.002079 30993 raft_consensus.cc:482] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d80c19eca274dce9243bf1c8b6b1c8a)
I20260811 05:03:53.002300 30993 raft_consensus.cc:504] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } }
I20260811 05:03:53.003453 30992 leader_election.cc:288] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d80c19eca274dce9243bf1c8b6b1c8a (127.22.49.254:37869), aca99b03ee8b418cae663dc5ffb91178 (127.22.49.252:42483)
I20260811 05:03:53.003264 30993 leader_election.cc:288] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d80c19eca274dce9243bf1c8b6b1c8a (127.22.49.254:37869), 471b9d6a44b9466abfc7c728de43d8ee (127.22.49.253:40519)
I20260811 05:03:53.004417 30994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:53.003433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:49998)
0811 05:03:53.004159 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:53.004240 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":66,"threads_started":1}
W20260811 05:03:53.004702 30388 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
I20260811 05:03:53.005602 30996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:53.003394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:49990)
0811 05:03:53.005443 (+ 2049us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:53.005515 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":66,"threads_started":1}
W20260811 05:03:53.005995 30186 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
I20260811 05:03:53.006632 30994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:53.006172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:50016)
0811 05:03:53.006512 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:53.006567 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":270}
W20260811 05:03:53.006803 30388 leader_election.cc:334] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1d80c19eca274dce9243bf1c8b6b1c8a (127.22.49.254:37869): Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
I20260811 05:03:53.007637 30996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:53.007371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:50022)
0811 05:03:53.007498 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:53.007543 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 05:03:53.007764 30186 leader_election.cc:334] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1d80c19eca274dce9243bf1c8b6b1c8a (127.22.49.254:37869): Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
I20260811 05:03:53.008857 30998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:53.003673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50358 (local address 127.22.49.252:42483)
0811 05:03:53.003884 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:53.003890 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:53.004131 (+ 241us) server_negotiation.cc:407] Connection header received
0811 05:03:53.004363 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:53.004367 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:53.004418 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:53.004481 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:53.004921 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:53.005713 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:53.007465 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:53.008149 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:53.008299 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:53.008381 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:53.008676 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 05:03:53.008734 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":70,"threads_started":1}
I20260811 05:03:53.008929 30995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:53.003392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:42483 (local address 127.0.0.1:50358)
0811 05:03:53.004044 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:53.004060 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:53.004232 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:53.004641 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:53.004644 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:53.004662 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:53.004790 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:53.004797 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:53.005870 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:53.005873 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:53.007310 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:53.007320 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:53.008296 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:53.008301 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:53.008544 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:53.008569 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 05:03:53.008663 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 05:03:53.008783 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"mutex_wait_us":332,"thread_start_us":44,"threads_started":1}
I20260811 05:03:53.008935 31000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:53.004034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34156 (local address 127.22.49.253:40519)
0811 05:03:53.004805 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:53.004809 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:53.004820 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:03:53.004857 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:53.004860 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:53.004909 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:53.004983 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:53.005344 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:53.006063 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:53.007620 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:53.008217 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:53.008352 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:53.008534 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:53.008658 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 05:03:53.008786 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":711,"thread_start_us":67,"threads_started":1}
I20260811 05:03:53.008868 30999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:53.003893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:40519 (local address 127.0.0.1:34156)
0811 05:03:53.004526 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:53.004541 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:53.004627 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:53.005065 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:53.005068 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:53.005086 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:53.005173 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:53.005179 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:53.006231 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:53.006238 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:53.007508 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:53.007517 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:53.008380 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:53.008421 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:53.008538 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:53.008565 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 05:03:53.008646 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 05:03:53.008724 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"mutex_wait_us":21,"thread_start_us":89,"threads_started":1}
I20260811 05:03:53.009452 30415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "471b9d6a44b9466abfc7c728de43d8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "aca99b03ee8b418cae663dc5ffb91178" is_pre_election: true
I20260811 05:03:53.009661 30415 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 471b9d6a44b9466abfc7c728de43d8ee in term 1.
I20260811 05:03:53.009919 30211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aca99b03ee8b418cae663dc5ffb91178" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "471b9d6a44b9466abfc7c728de43d8ee" is_pre_election: true
I20260811 05:03:53.010011 30185 leader_election.cc:302] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 471b9d6a44b9466abfc7c728de43d8ee, aca99b03ee8b418cae663dc5ffb91178; no voters: 1d80c19eca274dce9243bf1c8b6b1c8a
I20260811 05:03:53.010130 30211 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aca99b03ee8b418cae663dc5ffb91178 in term 1.
I20260811 05:03:53.010286 30992 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 05:03:53.010346 30992 raft_consensus.cc:482] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d80c19eca274dce9243bf1c8b6b1c8a)
I20260811 05:03:53.010386 30992 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 1 FOLLOWER]: Advancing to term 2
I20260811 05:03:53.010551 30386 leader_election.cc:302] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 471b9d6a44b9466abfc7c728de43d8ee, aca99b03ee8b418cae663dc5ffb91178; no voters: 1d80c19eca274dce9243bf1c8b6b1c8a
I20260811 05:03:53.010789 30993 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 05:03:53.010871 30993 raft_consensus.cc:482] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d80c19eca274dce9243bf1c8b6b1c8a)
I20260811 05:03:53.010923 30993 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 1 FOLLOWER]: Advancing to term 2
I20260811 05:03:53.011656 30992 raft_consensus.cc:504] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } }
I20260811 05:03:53.011958 30993 raft_consensus.cc:504] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } }
I20260811 05:03:53.012094 30992 leader_election.cc:288] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [CANDIDATE]: Term 2 election: Requested vote from peers 1d80c19eca274dce9243bf1c8b6b1c8a (127.22.49.254:37869), aca99b03ee8b418cae663dc5ffb91178 (127.22.49.252:42483)
I20260811 05:03:53.012354 30993 leader_election.cc:288] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [CANDIDATE]: Term 2 election: Requested vote from peers 1d80c19eca274dce9243bf1c8b6b1c8a (127.22.49.254:37869), 471b9d6a44b9466abfc7c728de43d8ee (127.22.49.253:40519)
I20260811 05:03:53.012743 30995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:53.012273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:50036)
0811 05:03:53.012578 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:53.012675 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236}
I20260811 05:03:53.012763 30415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "471b9d6a44b9466abfc7c728de43d8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "aca99b03ee8b418cae663dc5ffb91178"
I20260811 05:03:53.012925 30415 raft_consensus.cc:2379] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 471b9d6a44b9466abfc7c728de43d8ee in current term 2: Already voted for candidate aca99b03ee8b418cae663dc5ffb91178 in this term.
I20260811 05:03:53.013381 30211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aca99b03ee8b418cae663dc5ffb91178" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "471b9d6a44b9466abfc7c728de43d8ee"
I20260811 05:03:53.013536 30211 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aca99b03ee8b418cae663dc5ffb91178 in current term 2: Already voted for candidate 471b9d6a44b9466abfc7c728de43d8ee in this term.
I20260811 05:03:53.013633 30999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:53.012459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:50042)
0811 05:03:53.013483 (+ 1024us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:53.013540 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":916}
I20260811 05:03:53.013839 30995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:53.013263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:50044)
0811 05:03:53.013730 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:53.013778 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403}
W20260811 05:03:53.013944 30186 leader_election.cc:334] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1d80c19eca274dce9243bf1c8b6b1c8a (127.22.49.254:37869): Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
I20260811 05:03:53.014034 30186 leader_election.cc:302] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 471b9d6a44b9466abfc7c728de43d8ee; no voters: 1d80c19eca274dce9243bf1c8b6b1c8a, aca99b03ee8b418cae663dc5ffb91178
I20260811 05:03:53.014191 30992 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 05:03:53.014329 30999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:53.014091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:50048)
0811 05:03:53.014196 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:53.014255 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 05:03:53.014456 30388 leader_election.cc:334] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1d80c19eca274dce9243bf1c8b6b1c8a (127.22.49.254:37869): Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
I20260811 05:03:53.014536 30388 leader_election.cc:302] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aca99b03ee8b418cae663dc5ffb91178; no voters: 1d80c19eca274dce9243bf1c8b6b1c8a, 471b9d6a44b9466abfc7c728de43d8ee
I20260811 05:03:53.014708 30993 raft_consensus.cc:2726] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 05:03:53.488579 31004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:53.488144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.194:55123)
0811 05:03:53.488418 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:53.488479 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":111,"threads_started":1}
I20260811 05:03:53.488605 31005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:53.488185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.195:32825)
0811 05:03:53.488461 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:53.488517 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":104,"threads_started":1}
I20260811 05:03:53.495517 31007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:53.495000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.193:37185)
0811 05:03:53.495333 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:53.495412 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":108,"threads_started":1}
I20260811 05:03:54.489799 31008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.489374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.194:51309)
0811 05:03:54.489642 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.489705 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":105,"threads_started":1}
I20260811 05:03:54.489879 31009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.489518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.195:51789)
0811 05:03:54.489744 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.489797 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":82,"threads_started":1}
I20260811 05:03:54.496953 31010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.496220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.193:50421)
0811 05:03:54.496628 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.496711 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":97,"threads_started":1}
I20260811 05:03:54.589133 31011 raft_consensus.cc:482] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:54.589300 31011 raft_consensus.cc:504] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } }
I20260811 05:03:54.589888 31011 leader_election.cc:288] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1d80c19eca274dce9243bf1c8b6b1c8a (127.22.49.254:37869), 471b9d6a44b9466abfc7c728de43d8ee (127.22.49.253:40519)
I20260811 05:03:54.590515 30211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aca99b03ee8b418cae663dc5ffb91178" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "471b9d6a44b9466abfc7c728de43d8ee" is_pre_election: true
I20260811 05:03:54.590696 30211 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aca99b03ee8b418cae663dc5ffb91178 in term 2.
I20260811 05:03:54.590802 31012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.590278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:50260)
0811 05:03:54.590599 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.590700 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":140,"threads_started":1}
I20260811 05:03:54.591162 30386 leader_election.cc:302] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 471b9d6a44b9466abfc7c728de43d8ee, aca99b03ee8b418cae663dc5ffb91178; no voters:
I20260811 05:03:54.591374 31011 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 05:03:54.591465 31011 raft_consensus.cc:482] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:54.591526 31011 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 2 FOLLOWER]: Advancing to term 3
I20260811 05:03:54.591938 31012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.591623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:50264)
0811 05:03:54.591788 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.591853 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 05:03:54.592067 30388 leader_election.cc:334] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1d80c19eca274dce9243bf1c8b6b1c8a (127.22.49.254:37869): Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
I20260811 05:03:54.592850 31011 raft_consensus.cc:504] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } }
I20260811 05:03:54.593261 31011 leader_election.cc:288] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [CANDIDATE]: Term 3 election: Requested vote from peers 1d80c19eca274dce9243bf1c8b6b1c8a (127.22.49.254:37869), 471b9d6a44b9466abfc7c728de43d8ee (127.22.49.253:40519)
I20260811 05:03:54.593621 31012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.593382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:50272)
0811 05:03:54.593517 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.593564 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 05:03:54.593714 30211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aca99b03ee8b418cae663dc5ffb91178" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "471b9d6a44b9466abfc7c728de43d8ee"
I20260811 05:03:54.593875 30211 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 2 FOLLOWER]: Advancing to term 3
I20260811 05:03:54.594332 31012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.594133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:50288)
0811 05:03:54.594233 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.594284 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 05:03:54.594455 30388 leader_election.cc:334] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1d80c19eca274dce9243bf1c8b6b1c8a (127.22.49.254:37869): Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
I20260811 05:03:54.595202 30211 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aca99b03ee8b418cae663dc5ffb91178 in term 3.
I20260811 05:03:54.595605 30386 leader_election.cc:302] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 471b9d6a44b9466abfc7c728de43d8ee, aca99b03ee8b418cae663dc5ffb91178; no voters: 1d80c19eca274dce9243bf1c8b6b1c8a
I20260811 05:03:54.595819 31011 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 05:03:54.596064 31011 raft_consensus.cc:686] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [term 3 LEADER]: Becoming Leader. State: Replica: aca99b03ee8b418cae663dc5ffb91178, State: Running, Role: LEADER
I20260811 05:03:54.596362 31011 consensus_queue.cc:237] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } }
I20260811 05:03:54.597667 31014 sys_catalog.cc:455] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aca99b03ee8b418cae663dc5ffb91178. Latest consensus state: current_term: 3 leader_uuid: "aca99b03ee8b418cae663dc5ffb91178" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } } }
I20260811 05:03:54.597884 31014 sys_catalog.cc:458] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:54.598237 31016 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:54.600977 31016 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:54.601547 31016 catalog_manager.cc:1259] Loaded cluster ID: 5735a0a5b9074484aad2c9fa08cb2402
I20260811 05:03:54.601629 31016 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:54.602433 31016 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:54.603082 31016 catalog_manager.cc:5879] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: Loaded TSK: 0
I20260811 05:03:54.603855 31016 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:03:54.684298 30404 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50352:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:03:54.688093 30404 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:54.691468 31012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.691181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:50300)
0811 05:03:54.691308 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.691383 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 05:03:54.691594 30211 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [term 3 FOLLOWER]: Refusing update from remote peer aca99b03ee8b418cae663dc5ffb91178: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260811 05:03:54.692119 31011 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 05:03:54.692214 31012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.692000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.0.0.1:50316)
0811 05:03:54.692106 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.692158 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 05:03:54.692385 30388 consensus_peers.cc:487] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 -> Peer 1d80c19eca274dce9243bf1c8b6b1c8a (127.22.49.254:37869): Couldn't send request to peer 1d80c19eca274dce9243bf1c8b6b1c8a. Status: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 05:03:54.693747 31018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader aca99b03ee8b418cae663dc5ffb91178. Latest consensus state: current_term: 3 leader_uuid: "aca99b03ee8b418cae663dc5ffb91178" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } } }
I20260811 05:03:54.693899 31018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:03:54.695060 31011 sys_catalog.cc:455] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "aca99b03ee8b418cae663dc5ffb91178" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } } }
I20260811 05:03:54.695185 31011 sys_catalog.cc:458] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:54.695277 31018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "aca99b03ee8b418cae663dc5ffb91178" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1d80c19eca274dce9243bf1c8b6b1c8a" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37869 } } peers { permanent_uuid: "471b9d6a44b9466abfc7c728de43d8ee" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 40519 } attrs { promote: false } } peers { permanent_uuid: "aca99b03ee8b418cae663dc5ffb91178" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 42483 } attrs { promote: false } } }
I20260811 05:03:54.695446 31018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 471b9d6a44b9466abfc7c728de43d8ee [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:03:54.706835 31026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.702058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39802 (local address 127.22.49.193:39001)
0811 05:03:54.702575 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:54.702578 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:54.702589 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:03:54.702635 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:54.702637 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:54.702675 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:54.702774 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:54.703098 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.703888 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.705386 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.706010 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.706109 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:54.706177 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:54.706539 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 05:03:54.706661 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":100,"threads_started":1}
I20260811 05:03:54.707017 31025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.701895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:43167 (local address 127.0.0.1:52346)
0811 05:03:54.702288 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.702300 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:54.702386 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:54.703279 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:54.703282 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:54.703302 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:54.703406 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:54.703412 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.704546 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.704550 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:54.705651 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:54.705660 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.706527 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.706531 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:54.706668 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:54.706694 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 05:03:54.706767 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 05:03:54.706846 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":101,"threads_started":1}
I20260811 05:03:54.707034 31027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.702289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52346 (local address 127.22.49.194:43167)
0811 05:03:54.703045 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:54.703050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:54.703066 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:03:54.703118 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:54.703121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:54.703167 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:54.703250 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:54.703533 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.704264 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.705795 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.706420 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.706524 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:54.706584 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:54.706785 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 05:03:54.706874 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":77,"threads_started":1}
I20260811 05:03:54.708063 30684 tablet_service.cc:1467] Processing CreateTablet for tablet b40aeb3644d84349ab55d6c1bb48605d (DEFAULT_TABLE table=test-table [id=8151d7a397e14c03b7dd1b2e9a97dbad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:54.708158 31024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.701605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:39001 (local address 127.0.0.1:39802)
0811 05:03:54.702207 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.702222 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:54.702313 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:54.702783 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:54.702786 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:54.702803 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:54.702916 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:54.702923 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.704035 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.704038 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:54.705237 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:54.705247 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.706288 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.706291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:54.706385 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:54.706409 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 05:03:54.707906 (+ 1497us) client_negotiation.cc:240] Negotiation successful
0811 05:03:54.708009 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":114,"threads_started":1}
I20260811 05:03:54.708425 30684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b40aeb3644d84349ab55d6c1bb48605d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:54.708693 30528 tablet_service.cc:1467] Processing CreateTablet for tablet b40aeb3644d84349ab55d6c1bb48605d (DEFAULT_TABLE table=test-table [id=8151d7a397e14c03b7dd1b2e9a97dbad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:54.708982 30528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b40aeb3644d84349ab55d6c1bb48605d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:54.710968 31029 tablet_bootstrap.cc:492] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c: Bootstrap starting.
I20260811 05:03:54.711474 31012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.701056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:39195 (local address 127.0.0.1:59836)
0811 05:03:54.701161 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.701178 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:54.701274 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:54.707763 (+ 6489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:54.707768 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:54.707792 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:54.707896 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:54.707904 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.708971 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.708974 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:54.710054 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:54.710066 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.711044 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.711049 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:54.711148 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:54.711179 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 05:03:54.711242 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 05:03:54.711329 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 05:03:54.711627 31030 tablet_bootstrap.cc:492] T b40aeb3644d84349ab55d6c1bb48605d P c8189bebb83a4d8faba846c71da5a898: Bootstrap starting.
I20260811 05:03:54.712085 31028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.707193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59836 (local address 127.22.49.195:39195)
0811 05:03:54.707486 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:54.707492 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:54.707510 (+ 18us) server_negotiation.cc:407] Connection header received
0811 05:03:54.707571 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:54.707577 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:54.707635 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:54.708011 (+ 376us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:54.708122 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.708839 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.710207 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.710833 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.711747 (+ 914us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:54.711812 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:54.711849 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 05:03:54.711929 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":104,"threads_started":1}
I20260811 05:03:54.712604 31030 tablet_bootstrap.cc:654] T b40aeb3644d84349ab55d6c1bb48605d P c8189bebb83a4d8faba846c71da5a898: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:54.712793 31029 tablet_bootstrap.cc:654] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:54.712811 30834 tablet_service.cc:1467] Processing CreateTablet for tablet b40aeb3644d84349ab55d6c1bb48605d (DEFAULT_TABLE table=test-table [id=8151d7a397e14c03b7dd1b2e9a97dbad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:54.713090 30834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b40aeb3644d84349ab55d6c1bb48605d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:54.714118 31029 tablet_bootstrap.cc:492] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c: No bootstrap required, opened a new log
I20260811 05:03:54.714193 31029 ts_tablet_manager.cc:1397] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:54.714653 31029 raft_consensus.cc:348] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } }
I20260811 05:03:54.714766 31029 raft_consensus.cc:374] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:54.714792 31029 raft_consensus.cc:729] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ad31a850b0e427bbb551eb9dea8d44c, State: Initialized, Role: FOLLOWER
I20260811 05:03:54.714918 31029 consensus_queue.cc:260] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } }
I20260811 05:03:54.715296 31029 ts_tablet_manager.cc:1428] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:54.716257 31008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.715938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.194:48733)
0811 05:03:54.716101 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.716181 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 05:03:54.716966 31008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.716682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.194:55053)
0811 05:03:54.716815 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.716887 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 05:03:54.716288 31035 tablet_bootstrap.cc:492] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7: Bootstrap starting.
I20260811 05:03:54.718189 30757 heartbeater.cc:503] Master 127.22.49.252:42483 was elected leader, sending a full tablet report...
I20260811 05:03:54.718413 31035 tablet_bootstrap.cc:654] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:54.720119 31035 tablet_bootstrap.cc:492] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7: No bootstrap required, opened a new log
I20260811 05:03:54.720227 31035 ts_tablet_manager.cc:1397] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260811 05:03:54.720603 31030 tablet_bootstrap.cc:492] T b40aeb3644d84349ab55d6c1bb48605d P c8189bebb83a4d8faba846c71da5a898: No bootstrap required, opened a new log
I20260811 05:03:54.720719 31030 ts_tablet_manager.cc:1397] T b40aeb3644d84349ab55d6c1bb48605d P c8189bebb83a4d8faba846c71da5a898: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260811 05:03:54.720690 31035 raft_consensus.cc:348] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } }
I20260811 05:03:54.720819 31035 raft_consensus.cc:374] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:54.720870 31035 raft_consensus.cc:729] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d636ca1a3ab4bf99b43459f0821e1b7, State: Initialized, Role: FOLLOWER
I20260811 05:03:54.721004 31035 consensus_queue.cc:260] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } }
I20260811 05:03:54.721180 31030 raft_consensus.cc:348] T b40aeb3644d84349ab55d6c1bb48605d P c8189bebb83a4d8faba846c71da5a898 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } }
I20260811 05:03:54.721308 31030 raft_consensus.cc:374] T b40aeb3644d84349ab55d6c1bb48605d P c8189bebb83a4d8faba846c71da5a898 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:54.721350 31030 raft_consensus.cc:729] T b40aeb3644d84349ab55d6c1bb48605d P c8189bebb83a4d8faba846c71da5a898 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8189bebb83a4d8faba846c71da5a898, State: Initialized, Role: FOLLOWER
I20260811 05:03:54.721422 31035 ts_tablet_manager.cc:1428] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260811 05:03:54.721498 31030 consensus_queue.cc:260] T b40aeb3644d84349ab55d6c1bb48605d P c8189bebb83a4d8faba846c71da5a898 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } }
I20260811 05:03:54.721903 31030 ts_tablet_manager.cc:1428] T b40aeb3644d84349ab55d6c1bb48605d P c8189bebb83a4d8faba846c71da5a898: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 05:03:54.722209 31009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.721884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.195:48757)
0811 05:03:54.722071 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.722130 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260811 05:03:54.722586 31010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.722335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.193:47543)
0811 05:03:54.722455 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.722516 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 05:03:54.723032 30915 heartbeater.cc:503] Master 127.22.49.252:42483 was elected leader, sending a full tablet report...
I20260811 05:03:54.724539 31010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.724181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.193:38433)
0811 05:03:54.724323 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.724384 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 05:03:54.725112 30604 heartbeater.cc:503] Master 127.22.49.252:42483 was elected leader, sending a full tablet report...
I20260811 05:03:54.725672 31009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.723687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.195:44099)
0811 05:03:54.725543 (+ 1856us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.725601 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1755}
W20260811 05:03:54.792485 30918 tablet.cc:2369] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:03:54.805974 30762 tablet.cc:2369] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:03:54.830360 30607 tablet.cc:2369] T b40aeb3644d84349ab55d6c1bb48605d P c8189bebb83a4d8faba846c71da5a898: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:03:54.884935 31037 raft_consensus.cc:482] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:54.885102 31037 raft_consensus.cc:504] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } }
I20260811 05:03:54.886349 31037 leader_election.cc:288] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ad31a850b0e427bbb551eb9dea8d44c (127.22.49.194:43167), c8189bebb83a4d8faba846c71da5a898 (127.22.49.193:39001)
I20260811 05:03:54.890162 31027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.886755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:37189 (local address 127.22.49.194:43167)
0811 05:03:54.886894 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:54.886901 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:54.886920 (+ 19us) server_negotiation.cc:407] Connection header received
0811 05:03:54.887004 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:54.887007 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:54.887056 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:54.887129 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:54.887411 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.887918 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.889016 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.889545 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.889685 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:54.889739 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:54.889947 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 05:03:54.890026 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 05:03:54.890173 31009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.886579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:43167 (local address 127.22.49.195:37189)
0811 05:03:54.886720 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.886740 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:54.886867 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:54.887142 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:54.887145 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:54.887163 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:54.887278 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:54.887284 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.888038 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.888041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:54.888885 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:54.888895 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.889700 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.889704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:54.889808 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:54.889835 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 05:03:54.889915 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 05:03:54.890011 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":1}
I20260811 05:03:54.890816 31026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.886932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:42875 (local address 127.22.49.193:39001)
0811 05:03:54.887074 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:54.887081 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:54.887269 (+ 188us) server_negotiation.cc:407] Connection header received
0811 05:03:54.887486 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:54.887489 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:54.887535 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:54.887619 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:54.887890 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.888384 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.889515 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.890132 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.890253 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:54.890321 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:54.890617 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 05:03:54.890714 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 05:03:54.890820 31039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.886755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:39001 (local address 127.22.49.195:42875)
0811 05:03:54.887164 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.887177 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:54.887363 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:54.887634 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:54.887637 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:54.887653 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:54.887775 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:54.887781 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.888507 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.888511 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:54.889319 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:54.889329 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.890361 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.890365 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:54.890463 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:54.890484 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 05:03:54.890586 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 05:03:54.890659 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":172,"threads_started":1}
I20260811 05:03:54.890821 30707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b40aeb3644d84349ab55d6c1bb48605d" candidate_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" is_pre_election: true
I20260811 05:03:54.891007 30707 raft_consensus.cc:2454] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d636ca1a3ab4bf99b43459f0821e1b7 in term 0.
I20260811 05:03:54.891465 30784 leader_election.cc:302] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ad31a850b0e427bbb551eb9dea8d44c, 6d636ca1a3ab4bf99b43459f0821e1b7; no voters:
I20260811 05:03:54.891467 30550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b40aeb3644d84349ab55d6c1bb48605d" candidate_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8189bebb83a4d8faba846c71da5a898" is_pre_election: true
I20260811 05:03:54.891710 30550 raft_consensus.cc:2454] T b40aeb3644d84349ab55d6c1bb48605d P c8189bebb83a4d8faba846c71da5a898 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d636ca1a3ab4bf99b43459f0821e1b7 in term 0.
I20260811 05:03:54.891749 31037 raft_consensus.cc:2781] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:54.891804 31037 raft_consensus.cc:482] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:54.891861 31037 raft_consensus.cc:3037] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:54.892977 31037 raft_consensus.cc:504] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } }
I20260811 05:03:54.893404 31037 leader_election.cc:288] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [CANDIDATE]: Term 1 election: Requested vote from peers 2ad31a850b0e427bbb551eb9dea8d44c (127.22.49.194:43167), c8189bebb83a4d8faba846c71da5a898 (127.22.49.193:39001)
I20260811 05:03:54.893762 30707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b40aeb3644d84349ab55d6c1bb48605d" candidate_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad31a850b0e427bbb551eb9dea8d44c"
I20260811 05:03:54.893857 30550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b40aeb3644d84349ab55d6c1bb48605d" candidate_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8189bebb83a4d8faba846c71da5a898"
I20260811 05:03:54.893924 30707 raft_consensus.cc:3037] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:54.893997 30550 raft_consensus.cc:3037] T b40aeb3644d84349ab55d6c1bb48605d P c8189bebb83a4d8faba846c71da5a898 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:54.894909 30707 raft_consensus.cc:2454] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d636ca1a3ab4bf99b43459f0821e1b7 in term 1.
I20260811 05:03:54.895056 30550 raft_consensus.cc:2454] T b40aeb3644d84349ab55d6c1bb48605d P c8189bebb83a4d8faba846c71da5a898 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d636ca1a3ab4bf99b43459f0821e1b7 in term 1.
I20260811 05:03:54.895294 30784 leader_election.cc:302] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ad31a850b0e427bbb551eb9dea8d44c, 6d636ca1a3ab4bf99b43459f0821e1b7; no voters:
I20260811 05:03:54.895536 31037 raft_consensus.cc:2781] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:54.895766 31037 raft_consensus.cc:686] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 1 LEADER]: Becoming Leader. State: Replica: 6d636ca1a3ab4bf99b43459f0821e1b7, State: Running, Role: LEADER
I20260811 05:03:54.896037 31037 consensus_queue.cc:237] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } } peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } }
I20260811 05:03:54.896514 31039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.896245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.195:59637)
0811 05:03:54.896376 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.896434 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 05:03:54.899232 30404 catalog_manager.cc:5495] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d636ca1a3ab4bf99b43459f0821e1b7 (127.22.49.195). New cstate: current_term: 1 leader_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d636ca1a3ab4bf99b43459f0821e1b7" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 39195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 } health_report { overall_health: UNKNOWN } } }
I20260811 05:03:54.945792 31028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.942094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59838 (local address 127.22.49.195:39195)
0811 05:03:54.942228 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:54.942232 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:54.942245 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:03:54.942329 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:54.942331 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:54.942388 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:54.942520 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:54.942806 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.943348 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.944281 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:54.944530 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:54.944617 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:54.944876 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:54.945374 (+ 498us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:54.945504 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:54.945599 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 05:03:54.945664 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 05:03:54.949276 30707 raft_consensus.cc:1261] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c [term 1 FOLLOWER]: Refusing update from remote peer 6d636ca1a3ab4bf99b43459f0821e1b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:54.949676 30550 raft_consensus.cc:1261] T b40aeb3644d84349ab55d6c1bb48605d P c8189bebb83a4d8faba846c71da5a898 [term 1 FOLLOWER]: Refusing update from remote peer 6d636ca1a3ab4bf99b43459f0821e1b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:54.950001 31040 consensus_queue.cc:1035] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ad31a850b0e427bbb551eb9dea8d44c" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:54.950350 31037 consensus_queue.cc:1035] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8189bebb83a4d8faba846c71da5a898" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 39001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:54.952770 31008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.952426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.194:48085)
0811 05:03:54.952597 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.952665 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260811 05:03:54.953358 31010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.953093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.193:47803)
0811 05:03:54.953233 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.953286 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 05:03:54.956763 31039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.956280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.195:42379)
0811 05:03:54.956578 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.956645 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221}
I20260811 05:03:54.957191 31010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.956871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.193:55499)
0811 05:03:54.957049 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.957106 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 05:03:54.959892 31039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.959606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.195:45245)
0811 05:03:54.959745 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.959806 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 05:03:54.963035 31008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.962651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37869 (local address 127.22.49.194:58483)
0811 05:03:54.962864 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.962931 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:37869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
I20260811 05:03:54.967039 30404 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:54.967272 30404 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:54.972039 30404 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aca99b03ee8b418cae663dc5ffb91178: Sending DeleteTablet for 3 replicas of tablet b40aeb3644d84349ab55d6c1bb48605d
I20260811 05:03:54.973012 30684 tablet_service.cc:1514] Processing DeleteTablet for tablet b40aeb3644d84349ab55d6c1bb48605d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:54 UTC) from {username='oryx', principal='oryx/127.22.49.252@KRBTEST.COM'} at 127.0.0.1:52346
I20260811 05:03:54.973110 30528 tablet_service.cc:1514] Processing DeleteTablet for tablet b40aeb3644d84349ab55d6c1bb48605d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:54 UTC) from {username='oryx', principal='oryx/127.22.49.252@KRBTEST.COM'} at 127.0.0.1:39802
I20260811 05:03:54.973111 30834 tablet_service.cc:1514] Processing DeleteTablet for tablet b40aeb3644d84349ab55d6c1bb48605d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:54 UTC) from {username='oryx', principal='oryx/127.22.49.252@KRBTEST.COM'} at 127.0.0.1:59836
I20260811 05:03:54.973487 31054 tablet_replica.cc:330] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c: stopping tablet replica
I20260811 05:03:54.973692 31056 tablet_replica.cc:330] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7: stopping tablet replica
I20260811 05:03:54.973709 31054 raft_consensus.cc:2229] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:54.973933 31056 raft_consensus.cc:2229] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:03:54.973970 31054 raft_consensus.cc:2258] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:54.974347 31056 raft_consensus.cc:2258] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:54.974746 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 30360
I20260811 05:03:54.976495 31056 ts_tablet_manager.cc:1905] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:54.978430 31054 ts_tablet_manager.cc:1905] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:54.979638 31056 ts_tablet_manager.cc:1918] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:54.979815 31056 log.cc:1196] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/b40aeb3644d84349ab55d6c1bb48605d
I20260811 05:03:54.980228 31056 ts_tablet_manager.cc:1939] T b40aeb3644d84349ab55d6c1bb48605d P 6d636ca1a3ab4bf99b43459f0821e1b7: Deleting consensus metadata
I20260811 05:03:54.981253 30388 catalog_manager.cc:4841] TS 6d636ca1a3ab4bf99b43459f0821e1b7 (127.22.49.195:39195): tablet b40aeb3644d84349ab55d6c1bb48605d (table test-table [id=8151d7a397e14c03b7dd1b2e9a97dbad]) successfully deleted
I20260811 05:03:54.982611 31054 ts_tablet_manager.cc:1918] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:54.982756 31054 log.cc:1196] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/b40aeb3644d84349ab55d6c1bb48605d
I20260811 05:03:54.983234 31054 ts_tablet_manager.cc:1939] T b40aeb3644d84349ab55d6c1bb48605d P 2ad31a850b0e427bbb551eb9dea8d44c: Deleting consensus metadata
I20260811 05:03:54.984380 30386 catalog_manager.cc:4841] TS 2ad31a850b0e427bbb551eb9dea8d44c (127.22.49.194:43167): tablet b40aeb3644d84349ab55d6c1bb48605d (table test-table [id=8151d7a397e14c03b7dd1b2e9a97dbad]) successfully deleted
I20260811 05:03:54.988499 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 30612
I20260811 05:03:54.988888 31012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:54.988554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:39001 (local address 127.0.0.1:39804)
0811 05:03:54.988746 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:54.988796 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:39001: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260811 05:03:54.995338 30389 catalog_manager.cc:4584] TS c8189bebb83a4d8faba846c71da5a898 (127.22.49.193:39001): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b40aeb3644d84349ab55d6c1bb48605d: Network error: Client connection negotiation failed: client connection to 127.22.49.193:39001: connect: Connection refused (error 111)
I20260811 05:03:54.997457 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 30767
I20260811 05:03:55.008108 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 30052
I20260811 05:03:55.017165 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 30162
2026-08-11T05:03:55Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7790 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:03:55 dist-test-slave-w206 krb5kdc[31060](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:03:55 dist-test-slave-w206 krb5kdc[31060](info): set up 2 sockets
Aug 11 05:03:55 dist-test-slave-w206 krb5kdc[31060](info): commencing operation
krb5kdc: starting...
W20260811 05:03:56.140538 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:03:56 dist-test-slave-w206 krb5kdc[31060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:03:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:03:56Z Disabled control of system clock
WARNING: no policy specified for oryx/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.254.keytab.
Entry for principal oryx/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.254.keytab.
I20260811 05:03:56.287425 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:35527
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.254.keytab
--principal=oryx/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:41971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:35527
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:56.405485 31074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:56.405805 31074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:56.405848 31074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:56.410063 31074 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:03:56.410151 31074 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 05:03:56.410169 31074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:56.410188 31074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:56.410205 31074 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:03:56.410220 31074 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:03:56.416108 31074 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:41971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:35527
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.254.keytab
--principal=oryx/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:35527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:56.417366 31074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:56.418473 31074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:56.428349 31081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:56.428368 31079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:56.428369 31083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:56.428434 31074 server_base.cc:1034] running on GCE node
I20260811 05:03:56.429301 31074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:56.430570 31074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:56.431763 31074 hybrid_clock.cc:648] HybridClock initialized: now 1786424636431723 us; error 64 us; skew 500 ppm
Aug 11 05:03:56 dist-test-slave-w206 krb5kdc[31060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424636, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:56.439271 31074 init.cc:377] Logged in from keytab as oryx/127.22.49.254@KRBTEST.COM (short username oryx)
I20260811 05:03:56.440474 31074 webserver.cc:460] Webserver started at http://127.22.49.254:39647/ using document root <none> and password file <none>
I20260811 05:03:56.441126 31074 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:56.441197 31074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:56.441444 31074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:56.443779 31074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "70ed571ca5854c279ab6545aa2524287"
format_stamp: "Formatted at 2026-08-11 05:03:56 on dist-test-slave-w206"
server_key: "08b09826ab14c8a60e8262931a3c24d4"
server_key_iv: "f00d66caa7ff2cc8e621cc3275432df8"
server_key_version: "encryptionkey@0"
I20260811 05:03:56.444415 31074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "70ed571ca5854c279ab6545aa2524287"
format_stamp: "Formatted at 2026-08-11 05:03:56 on dist-test-slave-w206"
server_key: "08b09826ab14c8a60e8262931a3c24d4"
server_key_iv: "f00d66caa7ff2cc8e621cc3275432df8"
server_key_version: "encryptionkey@0"
I20260811 05:03:56.448591 31074 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:03:56.451442 31090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:56.452888 31074 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 05:03:56.453048 31074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "70ed571ca5854c279ab6545aa2524287"
format_stamp: "Formatted at 2026-08-11 05:03:56 on dist-test-slave-w206"
server_key: "08b09826ab14c8a60e8262931a3c24d4"
server_key_iv: "f00d66caa7ff2cc8e621cc3275432df8"
server_key_version: "encryptionkey@0"
I20260811 05:03:56.453179 31074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:56.470289 31074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:56.473953 31074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:56.474200 31074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:56.483151 31074 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:35527
I20260811 05:03:56.483172 31153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:35527 every 8 connection(s)
I20260811 05:03:56.484198 31074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:03:56.485572 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 31074
I20260811 05:03:56.485733 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:03:56.486063 22727 external_mini_cluster.cc:1428] Setting key 229ab20c813ee28c24a848b930160efe
I20260811 05:03:56.487646 31154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:56.494796 31154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287: Bootstrap starting.
Aug 11 05:03:56 dist-test-slave-w206 krb5kdc[31060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
I20260811 05:03:56.497750 31154 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:56.499087 31154 log.cc:824] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:56.501609 31154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287: No bootstrap required, opened a new log
I20260811 05:03:56.502481 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:56.487494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34810 (local address 127.22.49.254:35527)
0811 05:03:56.487992 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:56.488012 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:56.488054 (+ 42us) server_negotiation.cc:407] Connection header received
0811 05:03:56.488906 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:56.488930 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:56.489355 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:56.489727 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:56.490667 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:56.492199 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:56.493142 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:56.493897 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:56.494057 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:56.497149 (+ 3092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:56.497155 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:56.497171 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:56.497206 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:56.499282 (+ 2076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:56.499838 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:56.499848 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:56.499856 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:56.500025 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:56.500331 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:56.500333 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:56.500334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:56.500749 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:56.500933 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:56.501271 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 05:03:56.501635 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":154,"threads_started":1}
I20260811 05:03:56.505374 31154 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ed571ca5854c279ab6545aa2524287" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35527 } }
I20260811 05:03:56.505623 31154 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:56.505692 31154 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ed571ca5854c279ab6545aa2524287, State: Initialized, Role: FOLLOWER
I20260811 05:03:56.506098 31154 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ed571ca5854c279ab6545aa2524287" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35527 } }
I20260811 05:03:56.506219 31154 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:03:56.506284 31154 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:03:56.506397 31154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:56.507577 31154 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ed571ca5854c279ab6545aa2524287" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35527 } }
I20260811 05:03:56.507949 31154 leader_election.cc:302] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70ed571ca5854c279ab6545aa2524287; no voters:
I20260811 05:03:56.508306 31154 leader_election.cc:288] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:03:56.508536 31159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:56.508780 31159 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [term 1 LEADER]: Becoming Leader. State: Replica: 70ed571ca5854c279ab6545aa2524287, State: Running, Role: LEADER
I20260811 05:03:56.509146 31159 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ed571ca5854c279ab6545aa2524287" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35527 } }
I20260811 05:03:56.509769 31154 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:03:56.510373 31159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70ed571ca5854c279ab6545aa2524287. Latest consensus state: current_term: 1 leader_uuid: "70ed571ca5854c279ab6545aa2524287" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ed571ca5854c279ab6545aa2524287" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35527 } } }
I20260811 05:03:56.510609 31159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:56.510897 31161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70ed571ca5854c279ab6545aa2524287" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ed571ca5854c279ab6545aa2524287" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35527 } } }
I20260811 05:03:56.511024 31161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287 [sys.catalog]: This master's current role is: LEADER
I20260811 05:03:56.511286 31168 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:03:56.514510 31168 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:03:56.520974 31168 catalog_manager.cc:1347] Generated new cluster ID: 6484cd70d432450a8045e5c8e15c2f7b
I20260811 05:03:56.521072 31168 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:03:56.538524 31168 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:03:56.539943 31168 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:03:56.550137 31168 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287: Generated new TSK 0
I20260811 05:03:56.551126 31168 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.193.keytab.
Entry for principal oryx/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.193.keytab.
I20260811 05:03:56.590620 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35527
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.193.keytab
--principal=oryx/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:41971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:56.711946 31183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:56.712316 31183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:56.712410 31183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:56.716775 31183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:56.716885 31183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:56.716964 31183 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:03:56.717047 31183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:03:56.722759 31183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:41971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.193.keytab
--principal=oryx/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.49.254:35527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:56.724038 31183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:56.725128 31183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:56.735621 31191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:56.735621 31190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:56.735811 31183 server_base.cc:1034] running on GCE node
W20260811 05:03:56.735872 31193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:56.736563 31183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:56.737263 31183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:56.738461 31183 hybrid_clock.cc:648] HybridClock initialized: now 1786424636738443 us; error 34 us; skew 500 ppm
Aug 11 05:03:56 dist-test-slave-w206 krb5kdc[31060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424636, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:56.741591 31183 init.cc:377] Logged in from keytab as oryx/127.22.49.193@KRBTEST.COM (short username oryx)
I20260811 05:03:56.742704 31183 webserver.cc:460] Webserver started at http://127.22.49.193:44713/ using document root <none> and password file <none>
I20260811 05:03:56.743399 31183 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:56.743494 31183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:56.743713 31183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:56.745879 31183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "3b0ed08ad7124a59a445e1457ed54417"
format_stamp: "Formatted at 2026-08-11 05:03:56 on dist-test-slave-w206"
server_key: "fd4e0635ddc9d647b722827aad8cbef2"
server_key_iv: "c397d92eadb4e2671558928f647aace5"
server_key_version: "encryptionkey@0"
I20260811 05:03:56.746493 31183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "3b0ed08ad7124a59a445e1457ed54417"
format_stamp: "Formatted at 2026-08-11 05:03:56 on dist-test-slave-w206"
server_key: "fd4e0635ddc9d647b722827aad8cbef2"
server_key_iv: "c397d92eadb4e2671558928f647aace5"
server_key_version: "encryptionkey@0"
I20260811 05:03:56.750610 31183 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260811 05:03:56.753242 31202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:56.754515 31183 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:03:56.754668 31183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "3b0ed08ad7124a59a445e1457ed54417"
format_stamp: "Formatted at 2026-08-11 05:03:56 on dist-test-slave-w206"
server_key: "fd4e0635ddc9d647b722827aad8cbef2"
server_key_iv: "c397d92eadb4e2671558928f647aace5"
server_key_version: "encryptionkey@0"
I20260811 05:03:56.754794 31183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:56.799566 31183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:56.803592 31183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:56.803864 31183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:56.805583 31183 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:56.805675 31183 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:56.805766 31183 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:56.805814 31183 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 05:03:56 dist-test-slave-w206 krb5kdc[31060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424636, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
I20260811 05:03:56.818872 31183 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:46383
I20260811 05:03:56.818955 31332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:46383 every 8 connection(s)
I20260811 05:03:56.820277 31183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:03:56.822163 31212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:56.807392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35527 (local address 127.22.49.193:45279)
0811 05:03:56.807985 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:56.808049 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:56.809086 (+ 1037us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:56.809856 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:56.809867 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:56.810370 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:56.811140 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:56.811157 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:56.812263 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:56.812274 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:56.813264 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:56.813284 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:56.813843 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:56.813847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:56.814041 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:56.814762 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:56.814793 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:56.816871 (+ 2078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:56.818965 (+ 2094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:56.819001 (+ 36us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:56.819018 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:56.819403 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:56.819794 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:56.819800 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:56.819805 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:56.820011 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:56.820506 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:56.820511 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:56.820791 (+ 280us) client_negotiation.cc:769] Sending connection context
0811 05:03:56.821026 (+ 235us) client_negotiation.cc:240] Negotiation successful
0811 05:03:56.821391 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":175,"threads_started":1}
I20260811 05:03:56.822876 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:56.806813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:45279 (local address 127.22.49.254:35527)
0811 05:03:56.807011 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:56.807019 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:56.808185 (+ 1166us) server_negotiation.cc:407] Connection header received
0811 05:03:56.809370 (+ 1185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:56.809378 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:56.809457 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:56.809573 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:56.811333 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:56.812125 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:56.813423 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:56.813672 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:56.813799 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:56.817091 (+ 3292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:56.817095 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:56.817098 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:56.817135 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:56.818826 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:56.819581 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:56.819585 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:56.819586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:56.819684 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:56.820123 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:56.820126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:56.820127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:56.820331 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:56.820438 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:56.822613 (+ 2175us) server_negotiation.cc:299] Negotiation successful
0811 05:03:56.822757 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 05:03:56.824102 31334 heartbeater.cc:347] Connected to a master server at 127.22.49.254:35527
I20260811 05:03:56.824301 31334 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:56.824992 31334 heartbeater.cc:511] Master 127.22.49.254:35527 requested a full tablet report, sending...
I20260811 05:03:56.827078 31106 ts_manager.cc:194] Registered new tserver with Master: 3b0ed08ad7124a59a445e1457ed54417 (127.22.49.193:46383)
I20260811 05:03:56.828392 31106 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:45279
I20260811 05:03:56.829988 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 31183
I20260811 05:03:56.830161 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:03:56.830610 22727 external_mini_cluster.cc:1428] Setting key d7642c1ff7e3fc6d9d08a85087a694d8
I20260811 05:03:56.835227 31342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:56.826611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35527 (local address 127.22.49.193:48475)
0811 05:03:56.827083 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:56.827095 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:56.827233 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:56.827590 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:56.827593 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:56.827833 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:56.827943 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:56.827950 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:56.828772 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:56.828776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:56.829525 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:56.829536 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:56.830393 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:56.830399 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:56.830508 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:56.831216 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:56.831229 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:56.831620 (+ 391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:56.833520 (+ 1900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:56.833523 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:56.833525 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:56.833752 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:56.834036 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:56.834040 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:56.834042 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:56.834137 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:56.834580 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:56.834583 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:56.834691 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 05:03:56.834807 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 05:03:56.834977 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":111,"threads_started":1}
I20260811 05:03:56.835219 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:56.826838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:48475 (local address 127.22.49.254:35527)
0811 05:03:56.827009 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:56.827015 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:56.827180 (+ 165us) server_negotiation.cc:407] Connection header received
0811 05:03:56.827406 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:56.827410 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:56.827467 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:56.827574 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:56.828066 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:56.828635 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:56.829704 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:56.830082 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:56.830223 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:56.831757 (+ 1534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:56.831761 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:56.831764 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:56.831793 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:56.833393 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:56.833851 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:56.833855 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:56.833857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:56.833942 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:56.834247 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:56.834255 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:56.834257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:56.834473 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:56.834597 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:56.834864 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 05:03:56.835024 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
WARNING: no policy specified for oryx/127.22.49.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.49.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.194.keytab.
Entry for principal oryx/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.194.keytab.
I20260811 05:03:56.866449 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35527
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.194.keytab
--principal=oryx/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:41971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:56.985327 31346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:56.985651 31346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:56.985700 31346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:56.990006 31346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:56.990096 31346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:56.990139 31346 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:03:56.990172 31346 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:03:56.995858 31346 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:41971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.194.keytab
--principal=oryx/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.49.254:35527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:56.997002 31346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:56.998044 31346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:57.009014 31352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:57.009006 31353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:57.009006 31355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:57.009287 31346 server_base.cc:1034] running on GCE node
I20260811 05:03:57.009986 31346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:57.010834 31346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:57.012100 31346 hybrid_clock.cc:648] HybridClock initialized: now 1786424637012036 us; error 87 us; skew 500 ppm
Aug 11 05:03:57 dist-test-slave-w206 krb5kdc[31060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424637, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:57.015754 31346 init.cc:377] Logged in from keytab as oryx/127.22.49.194@KRBTEST.COM (short username oryx)
I20260811 05:03:57.016930 31346 webserver.cc:460] Webserver started at http://127.22.49.194:42723/ using document root <none> and password file <none>
I20260811 05:03:57.017608 31346 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:57.017719 31346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:57.017997 31346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:57.020546 31346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "2fc6961b319e47e6ac72953c546d8bc7"
format_stamp: "Formatted at 2026-08-11 05:03:57 on dist-test-slave-w206"
server_key: "7575a0fea41d7c64dcb82dd3f8200469"
server_key_iv: "64a38688c71ae60443217a4808b80e27"
server_key_version: "encryptionkey@0"
I20260811 05:03:57.021253 31346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "2fc6961b319e47e6ac72953c546d8bc7"
format_stamp: "Formatted at 2026-08-11 05:03:57 on dist-test-slave-w206"
server_key: "7575a0fea41d7c64dcb82dd3f8200469"
server_key_iv: "64a38688c71ae60443217a4808b80e27"
server_key_version: "encryptionkey@0"
I20260811 05:03:57.026261 31346 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 05:03:57.029374 31362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:57.030838 31346 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:57.031044 31346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "2fc6961b319e47e6ac72953c546d8bc7"
format_stamp: "Formatted at 2026-08-11 05:03:57 on dist-test-slave-w206"
server_key: "7575a0fea41d7c64dcb82dd3f8200469"
server_key_iv: "64a38688c71ae60443217a4808b80e27"
server_key_version: "encryptionkey@0"
I20260811 05:03:57.031196 31346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:57.055508 31346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:57.059304 31346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:57.059594 31346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:57.061214 31346 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:57.061295 31346 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:57.061372 31346 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:57.061420 31346 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:57.072659 31346 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:43743
I20260811 05:03:57.072834 31493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:43743 every 8 connection(s)
Aug 11 05:03:57 dist-test-slave-w206 krb5kdc[31060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424637, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
I20260811 05:03:57.073850 31346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:03:57.075307 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 31346
I20260811 05:03:57.075451 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:03:57.075790 22727 external_mini_cluster.cc:1428] Setting key 5f5f8ad48e37564ef69207f9d20a2e43
I20260811 05:03:57.078259 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.062528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:59069 (local address 127.22.49.254:35527)
0811 05:03:57.062672 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:57.062675 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:57.063968 (+ 1293us) server_negotiation.cc:407] Connection header received
0811 05:03:57.065476 (+ 1508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:57.065480 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:57.065548 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:57.065652 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:57.067413 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.068336 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.069658 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.070043 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.070181 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.073677 (+ 3496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:57.073681 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:57.073683 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:57.073715 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:57.075622 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:57.076348 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:57.076354 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:57.076358 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:57.076470 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:57.076878 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:57.076882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:57.076883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:57.077112 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:57.077228 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:57.077841 (+ 613us) server_negotiation.cc:299] Negotiation successful
0811 05:03:57.078073 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 05:03:57.079272 31372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.063123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35527 (local address 127.22.49.194:59069)
0811 05:03:57.063720 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:57.063767 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:57.065168 (+ 1401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:57.065913 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:57.065925 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:57.066510 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:57.067248 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.067263 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.068483 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.068487 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.069506 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.069517 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.070246 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.070253 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.070500 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.071326 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:57.071357 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:57.073444 (+ 2087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:57.075781 (+ 2337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:57.075787 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:57.075805 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:57.076210 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:57.076578 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:57.076585 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:57.076588 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:57.076765 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:57.077230 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:57.077237 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:57.077569 (+ 332us) client_negotiation.cc:769] Sending connection context
0811 05:03:57.077776 (+ 207us) client_negotiation.cc:240] Negotiation successful
0811 05:03:57.078229 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":156,"threads_started":1}
I20260811 05:03:57.081193 31494 heartbeater.cc:347] Connected to a master server at 127.22.49.254:35527
I20260811 05:03:57.081369 31494 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:57.082056 31494 heartbeater.cc:511] Master 127.22.49.254:35527 requested a full tablet report, sending...
I20260811 05:03:57.083930 31106 ts_manager.cc:194] Registered new tserver with Master: 2fc6961b319e47e6ac72953c546d8bc7 (127.22.49.194:43743)
I20260811 05:03:57.084766 31106 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:59069
WARNING: no policy specified for oryx/127.22.49.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.49.195@KRBTEST.COM" created.
I20260811 05:03:57.093128 31502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.083820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35527 (local address 127.22.49.194:48545)
0811 05:03:57.084340 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:57.084356 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:57.084471 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:57.084785 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:57.084792 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:57.085042 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:57.085207 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.085216 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.086334 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.086338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.087189 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.087199 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.087900 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.087903 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.087992 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.088664 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:57.088686 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:57.089072 (+ 386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:57.091166 (+ 2094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:57.091168 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:57.091170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:57.091392 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:57.091809 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:57.091816 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:57.091820 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:57.091942 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:57.092598 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:57.092601 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:57.092696 (+ 95us) client_negotiation.cc:769] Sending connection context
0811 05:03:57.092808 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 05:03:57.092956 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":306,"threads_started":1}
I20260811 05:03:57.093278 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.083880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:48545 (local address 127.22.49.254:35527)
0811 05:03:57.084028 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:57.084034 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:57.084448 (+ 414us) server_negotiation.cc:407] Connection header received
0811 05:03:57.084562 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:57.084567 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:57.084635 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:57.084731 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:57.085336 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.086172 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.087326 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.087737 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.087852 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.089246 (+ 1394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:57.089249 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:57.089252 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:57.089339 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:57.090948 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:57.091553 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:57.091559 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:57.091562 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:57.091664 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:57.092053 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:57.092055 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:57.092056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:57.092463 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:57.092583 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:57.092873 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 05:03:57.093031 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.195.keytab.
Entry for principal oryx/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.195.keytab.
I20260811 05:03:57.111543 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35527
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.195.keytab
--principal=oryx/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:41971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:03:57.240341 31504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:03:57.240648 31504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:03:57.240696 31504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:03:57.244987 31504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:03:57.245074 31504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:03:57.245118 31504 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 05:03:57.245153 31504 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:03:57.251199 31504 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:41971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.195.keytab
--principal=oryx/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.49.254:35527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:03:57.252379 31504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:03:57.253417 31504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:03:57.263972 31512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:57.263973 31509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:03:57.263993 31510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:03:57.264452 31504 server_base.cc:1034] running on GCE node
I20260811 05:03:57.264901 31504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:03:57.265673 31504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:03:57.266882 31504 hybrid_clock.cc:648] HybridClock initialized: now 1786424637266865 us; error 32 us; skew 500 ppm
Aug 11 05:03:57 dist-test-slave-w206 krb5kdc[31060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424637, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:03:57.270066 31504 init.cc:377] Logged in from keytab as oryx/127.22.49.195@KRBTEST.COM (short username oryx)
I20260811 05:03:57.271265 31504 webserver.cc:460] Webserver started at http://127.22.49.195:46833/ using document root <none> and password file <none>
I20260811 05:03:57.271890 31504 fs_manager.cc:359] Metadata directory not provided
I20260811 05:03:57.271984 31504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:03:57.272226 31504 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:03:57.274490 31504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "7a383a30e3c34f2082fd5d1d87338ef4"
format_stamp: "Formatted at 2026-08-11 05:03:57 on dist-test-slave-w206"
server_key: "f93d7077c87f0cfa1c667814ed0626fe"
server_key_iv: "8b49b0411873f71255a5e3f9c35c0ad3"
server_key_version: "encryptionkey@0"
I20260811 05:03:57.275178 31504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "7a383a30e3c34f2082fd5d1d87338ef4"
format_stamp: "Formatted at 2026-08-11 05:03:57 on dist-test-slave-w206"
server_key: "f93d7077c87f0cfa1c667814ed0626fe"
server_key_iv: "8b49b0411873f71255a5e3f9c35c0ad3"
server_key_version: "encryptionkey@0"
I20260811 05:03:57.279425 31504 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 05:03:57.282275 31519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:57.283846 31504 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:03:57.284021 31504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "7a383a30e3c34f2082fd5d1d87338ef4"
format_stamp: "Formatted at 2026-08-11 05:03:57 on dist-test-slave-w206"
server_key: "f93d7077c87f0cfa1c667814ed0626fe"
server_key_iv: "8b49b0411873f71255a5e3f9c35c0ad3"
server_key_version: "encryptionkey@0"
I20260811 05:03:57.284171 31504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:03:57.308063 31504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:03:57.311828 31504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:03:57.312057 31504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:03:57.313699 31504 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:03:57.313789 31504 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:03:57.313869 31504 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:03:57.313913 31504 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 05:03:57 dist-test-slave-w206 krb5kdc[31060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424637, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
I20260811 05:03:57.326164 31504 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:41113
I20260811 05:03:57.326186 31649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:41113 every 8 connection(s)
I20260811 05:03:57.327237 31504 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:03:57.329864 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.314671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:40539 (local address 127.22.49.254:35527)
0811 05:03:57.314862 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:57.314870 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:57.315866 (+ 996us) server_negotiation.cc:407] Connection header received
0811 05:03:57.317267 (+ 1401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:57.317276 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:57.317358 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:57.317432 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:57.319672 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.320298 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.321682 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.321945 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.322072 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.325355 (+ 3283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:57.325359 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:57.325362 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:57.325403 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:57.327351 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:57.328011 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:57.328015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:57.328017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:57.328126 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:57.328720 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:57.328723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:57.328725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:57.328959 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:57.329052 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:57.329604 (+ 552us) server_negotiation.cc:299] Negotiation successful
0811 05:03:57.329734 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 05:03:57.330739 31532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.315131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35527 (local address 127.22.49.195:40539)
0811 05:03:57.315663 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:57.315730 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:57.316949 (+ 1219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:57.318044 (+ 1095us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:57.318055 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:57.318623 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:57.319490 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.319517 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.320455 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.320458 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.321559 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.321572 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.322138 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.322141 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.322329 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.323119 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:57.323137 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:57.325151 (+ 2014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:57.327476 (+ 2325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:57.327482 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:57.327498 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:57.327866 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:57.328255 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:57.328257 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:57.328259 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:57.328441 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:57.329080 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:57.329086 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:57.329351 (+ 265us) client_negotiation.cc:769] Sending connection context
0811 05:03:57.329518 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 05:03:57.329800 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":107,"threads_started":1}
I20260811 05:03:57.331110 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 31504
I20260811 05:03:57.331271 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:03:57.331707 22727 external_mini_cluster.cc:1428] Setting key d3175a5de25526d0364c523ec72c0cd4
I20260811 05:03:57.332322 31650 heartbeater.cc:347] Connected to a master server at 127.22.49.254:35527
I20260811 05:03:57.332464 31650 heartbeater.cc:464] Registering TS with master...
I20260811 05:03:57.333086 31650 heartbeater.cc:511] Master 127.22.49.254:35527 requested a full tablet report, sending...
I20260811 05:03:57.334230 31107 ts_manager.cc:194] Registered new tserver with Master: 7a383a30e3c34f2082fd5d1d87338ef4 (127.22.49.195:41113)
I20260811 05:03:57.335139 31107 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:40539
I20260811 05:03:57.342592 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.334731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:52881 (local address 127.22.49.254:35527)
0811 05:03:57.334866 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:57.334871 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:57.335077 (+ 206us) server_negotiation.cc:407] Connection header received
0811 05:03:57.335316 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:57.335319 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:57.335372 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:57.335464 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:57.336125 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.336879 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.337816 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.338033 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.338141 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.339486 (+ 1345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:57.339489 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:57.339492 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:57.339516 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:57.341043 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:57.341511 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:57.341514 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:57.341515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:57.341595 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:57.341831 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:57.341834 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:57.341835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:57.342047 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:57.342124 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:57.342358 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 05:03:57.342464 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 05:03:57.342613 31656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.334609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35527 (local address 127.22.49.195:52881)
0811 05:03:57.334948 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:57.335014 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:57.335176 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:57.335527 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:57.335534 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:57.335826 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:57.335967 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.335974 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.337079 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.337082 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.337676 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.337686 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.338168 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.338171 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.338247 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.338824 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:57.338836 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:57.339342 (+ 506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:57.341178 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:57.341181 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:57.341183 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:57.341416 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:57.341675 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:57.341677 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:57.341679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:57.341759 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:57.342126 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:57.342128 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:57.342214 (+ 86us) client_negotiation.cc:769] Sending connection context
0811 05:03:57.342298 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 05:03:57.342467 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":124,"threads_started":1}
I20260811 05:03:57.345907 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 05:03:57 dist-test-slave-w206 krb5kdc[31060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424637, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 05:03:57 dist-test-slave-w206 krb5kdc[31060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:03:57 dist-test-slave-w206 krb5kdc[31060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 05:03:57.373116 31157 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:03:57.366321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34826 (local address 127.22.49.254:35527)
0811 05:03:57.366487 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:57.366490 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:57.366505 (+ 15us) server_negotiation.cc:407] Connection header received
0811 05:03:57.366549 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:57.366551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:57.366598 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:57.366669 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:57.367513 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.368040 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.368875 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.369084 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.369161 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.372911 (+ 3750us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34826: BlockingRecv error: recv got EOF from 127.0.0.1:34826 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 05:03:57 dist-test-slave-w206 krb5kdc[31060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424637, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
I20260811 05:03:57.383612 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.374877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34840 (local address 127.22.49.254:35527)
0811 05:03:57.375168 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:57.375171 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:57.375188 (+ 17us) server_negotiation.cc:407] Connection header received
0811 05:03:57.375297 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:57.375301 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:57.375349 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:57.375427 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:57.376109 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.376623 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.377437 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.377657 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.377741 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.380374 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:57.380378 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:57.380380 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:57.380411 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:57.381828 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:57.382356 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:57.382359 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:57.382360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:57.382444 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:57.382746 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:57.382749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:57.382751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:57.383050 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:57.383164 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:57.383373 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 05:03:57.383481 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212}
I20260811 05:03:57.386641 31107 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34840:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:03:57.390040 31107 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:57.405644 31674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.399705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:41113 (local address 127.0.0.1:35696)
0811 05:03:57.400749 (+ 1044us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:57.400764 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:57.400849 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:57.401465 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:57.401471 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:57.401493 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:57.401653 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.401659 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.402807 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.402821 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.404178 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.404189 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.405072 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.405076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.405190 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.405235 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 05:03:57.405349 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 05:03:57.405483 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":990,"thread_start_us":133,"threads_started":1}
I20260811 05:03:57.405673 31678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.400503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35696 (local address 127.22.49.195:41113)
0811 05:03:57.400944 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:57.400955 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:57.400982 (+ 27us) server_negotiation.cc:407] Connection header received
0811 05:03:57.401063 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:57.401069 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:57.401280 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:57.401465 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:57.401807 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.402681 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.404297 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.404950 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.405062 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.405235 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:57.405403 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 05:03:57.405505 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":108,"threads_started":1}
I20260811 05:03:57.406451 31677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.400433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:43743 (local address 127.0.0.1:53880)
0811 05:03:57.401153 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:57.401166 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:57.401247 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:57.401719 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:57.401724 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:57.401747 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:57.401869 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.401876 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.403343 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.403346 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.404668 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.404679 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.406006 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.406010 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.406141 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.406173 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 05:03:57.406248 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 05:03:57.406321 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"mutex_wait_us":20,"thread_start_us":122,"threads_started":1}
I20260811 05:03:57.406659 31676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.399766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60326 (local address 127.22.49.193:46383)
0811 05:03:57.400743 (+ 977us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:57.400751 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:57.400780 (+ 29us) server_negotiation.cc:407] Connection header received
0811 05:03:57.400903 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:57.400910 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:57.401328 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:57.401492 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:57.401953 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.403205 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.405163 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.405977 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.406104 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.406248 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:57.406406 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 05:03:57.406509 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":865,"thread_start_us":104,"threads_started":1}
I20260811 05:03:57.406771 31675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.399654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:46383 (local address 127.0.0.1:60326)
0811 05:03:57.400251 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:57.400309 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:57.400440 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:57.401639 (+ 1199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:57.401645 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:57.401669 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:57.401787 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.401794 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.403343 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.403346 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.404802 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.404810 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.406105 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.406109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.406241 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.406268 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 05:03:57.406368 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 05:03:57.406443 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":323,"thread_start_us":114,"threads_started":1}
I20260811 05:03:57.406885 31679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.400888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53880 (local address 127.22.49.194:43743)
0811 05:03:57.401287 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:57.401300 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:57.401320 (+ 20us) server_negotiation.cc:407] Connection header received
0811 05:03:57.401408 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:57.401414 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:57.401577 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:57.401725 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:57.401995 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.403194 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.404817 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.405666 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.405776 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.405935 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:57.406640 (+ 705us) server_negotiation.cc:299] Negotiation successful
0811 05:03:57.406737 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":121,"threads_started":1}
I20260811 05:03:57.409159 31578 tablet_service.cc:1467] Processing CreateTablet for tablet d4bad1e57ef24ab2be8857da47a3ba42 (DEFAULT_TABLE table=test-table [id=c8a55b11a3a4472eae76f8c39a656d88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:57.409576 31259 tablet_service.cc:1467] Processing CreateTablet for tablet d4bad1e57ef24ab2be8857da47a3ba42 (DEFAULT_TABLE table=test-table [id=c8a55b11a3a4472eae76f8c39a656d88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:57.410333 31578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4bad1e57ef24ab2be8857da47a3ba42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:57.410568 31259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4bad1e57ef24ab2be8857da47a3ba42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:57.413968 31421 tablet_service.cc:1467] Processing CreateTablet for tablet d4bad1e57ef24ab2be8857da47a3ba42 (DEFAULT_TABLE table=test-table [id=c8a55b11a3a4472eae76f8c39a656d88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:57.415236 31421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4bad1e57ef24ab2be8857da47a3ba42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:57.416864 31680 tablet_bootstrap.cc:492] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417: Bootstrap starting.
I20260811 05:03:57.419698 31680 tablet_bootstrap.cc:654] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:57.420477 31680 log.cc:824] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:57.421136 31682 tablet_bootstrap.cc:492] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4: Bootstrap starting.
I20260811 05:03:57.422638 31680 tablet_bootstrap.cc:492] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417: No bootstrap required, opened a new log
I20260811 05:03:57.422907 31680 ts_tablet_manager.cc:1397] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 05:03:57.423166 31682 tablet_bootstrap.cc:654] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:57.424119 31682 log.cc:824] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:57.424715 31684 tablet_bootstrap.cc:492] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7: Bootstrap starting.
I20260811 05:03:57.426471 31682 tablet_bootstrap.cc:492] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4: No bootstrap required, opened a new log
I20260811 05:03:57.426689 31682 ts_tablet_manager.cc:1397] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260811 05:03:57.426867 31684 tablet_bootstrap.cc:654] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:57.427628 31684 log.cc:824] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7: Log is configured to *not* fsync() on all Append() calls
I20260811 05:03:57.427734 31680 raft_consensus.cc:348] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } }
I20260811 05:03:57.428052 31680 raft_consensus.cc:374] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:57.428128 31680 raft_consensus.cc:729] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b0ed08ad7124a59a445e1457ed54417, State: Initialized, Role: FOLLOWER
I20260811 05:03:57.428612 31680 consensus_queue.cc:260] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } }
I20260811 05:03:57.429384 31334 heartbeater.cc:503] Master 127.22.49.254:35527 was elected leader, sending a full tablet report...
I20260811 05:03:57.429699 31680 ts_tablet_manager.cc:1428] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 05:03:57.430351 31684 tablet_bootstrap.cc:492] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7: No bootstrap required, opened a new log
I20260811 05:03:57.430617 31684 ts_tablet_manager.cc:1397] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 05:03:57.431510 31682 raft_consensus.cc:348] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } }
I20260811 05:03:57.431756 31682 raft_consensus.cc:374] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:57.431818 31682 raft_consensus.cc:729] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a383a30e3c34f2082fd5d1d87338ef4, State: Initialized, Role: FOLLOWER
I20260811 05:03:57.432332 31682 consensus_queue.cc:260] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } }
I20260811 05:03:57.433423 31682 ts_tablet_manager.cc:1428] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260811 05:03:57.433804 31650 heartbeater.cc:503] Master 127.22.49.254:35527 was elected leader, sending a full tablet report...
I20260811 05:03:57.434410 31684 raft_consensus.cc:348] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } }
I20260811 05:03:57.434604 31684 raft_consensus.cc:374] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:57.434636 31684 raft_consensus.cc:729] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc6961b319e47e6ac72953c546d8bc7, State: Initialized, Role: FOLLOWER
I20260811 05:03:57.435117 31684 consensus_queue.cc:260] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } }
I20260811 05:03:57.435891 31494 heartbeater.cc:503] Master 127.22.49.254:35527 was elected leader, sending a full tablet report...
I20260811 05:03:57.437165 31684 ts_tablet_manager.cc:1428] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260811 05:03:57.571962 31335 tablet.cc:2369] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:03:57.575563 31495 tablet.cc:2369] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:03:57.578308 31651 tablet.cc:2369] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:03:57.760492 31689 raft_consensus.cc:482] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:57.760708 31689 raft_consensus.cc:504] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } }
I20260811 05:03:57.761823 31689 leader_election.cc:288] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b0ed08ad7124a59a445e1457ed54417 (127.22.49.193:46383), 2fc6961b319e47e6ac72953c546d8bc7 (127.22.49.194:43743)
I20260811 05:03:57.765671 31676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.762236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:34631 (local address 127.22.49.193:46383)
0811 05:03:57.762372 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:57.762377 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:57.762397 (+ 20us) server_negotiation.cc:407] Connection header received
0811 05:03:57.762568 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:57.762572 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:57.762624 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:57.762730 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:57.763056 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.763582 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.764647 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.765094 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.765229 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.765288 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:57.765468 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 05:03:57.765543 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 05:03:57.765671 31532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.762157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:46383 (local address 127.22.49.195:34631)
0811 05:03:57.762295 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:57.762313 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:57.762424 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:57.762746 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:57.762749 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:57.762768 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:57.762907 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.762913 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.763698 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.763703 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.764510 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.764519 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.765218 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.765222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.765334 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.765363 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 05:03:57.765449 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 05:03:57.765527 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 05:03:57.766511 31679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.762665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:35945 (local address 127.22.49.194:43743)
0811 05:03:57.762799 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:57.762805 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:57.763058 (+ 253us) server_negotiation.cc:407] Connection header received
0811 05:03:57.763192 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:57.763195 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:57.763240 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:57.763322 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:57.763963 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.764460 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.765455 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.765988 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.766108 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.766168 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:57.766350 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 05:03:57.766412 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 05:03:57.766532 31691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.762503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:43743 (local address 127.22.49.195:35945)
0811 05:03:57.762943 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:57.762953 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:57.763086 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:57.763334 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:57.763337 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:57.763383 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:57.763846 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.763854 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.764573 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.764576 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.765325 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.765333 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.766130 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.766134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.766231 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.766255 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 05:03:57.766334 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 05:03:57.766396 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":152,"threads_started":1}
I20260811 05:03:57.766477 31280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4bad1e57ef24ab2be8857da47a3ba42" candidate_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b0ed08ad7124a59a445e1457ed54417" is_pre_election: true
I20260811 05:03:57.766870 31280 raft_consensus.cc:2454] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a383a30e3c34f2082fd5d1d87338ef4 in term 0.
I20260811 05:03:57.767148 31446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4bad1e57ef24ab2be8857da47a3ba42" candidate_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc6961b319e47e6ac72953c546d8bc7" is_pre_election: true
I20260811 05:03:57.767426 31446 raft_consensus.cc:2454] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a383a30e3c34f2082fd5d1d87338ef4 in term 0.
I20260811 05:03:57.767447 31523 leader_election.cc:302] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b0ed08ad7124a59a445e1457ed54417, 7a383a30e3c34f2082fd5d1d87338ef4; no voters:
I20260811 05:03:57.767741 31689 raft_consensus.cc:2781] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:57.767838 31689 raft_consensus.cc:482] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:57.767894 31689 raft_consensus.cc:3037] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:57.768980 31689 raft_consensus.cc:504] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } }
I20260811 05:03:57.769328 31689 leader_election.cc:288] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [CANDIDATE]: Term 1 election: Requested vote from peers 3b0ed08ad7124a59a445e1457ed54417 (127.22.49.193:46383), 2fc6961b319e47e6ac72953c546d8bc7 (127.22.49.194:43743)
I20260811 05:03:57.769660 31280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4bad1e57ef24ab2be8857da47a3ba42" candidate_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b0ed08ad7124a59a445e1457ed54417"
I20260811 05:03:57.769757 31446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4bad1e57ef24ab2be8857da47a3ba42" candidate_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc6961b319e47e6ac72953c546d8bc7"
I20260811 05:03:57.769801 31280 raft_consensus.cc:3037] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:57.769886 31446 raft_consensus.cc:3037] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:57.771283 31446 raft_consensus.cc:2454] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a383a30e3c34f2082fd5d1d87338ef4 in term 1.
I20260811 05:03:57.771283 31280 raft_consensus.cc:2454] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a383a30e3c34f2082fd5d1d87338ef4 in term 1.
I20260811 05:03:57.771605 31523 leader_election.cc:302] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b0ed08ad7124a59a445e1457ed54417, 7a383a30e3c34f2082fd5d1d87338ef4; no voters:
I20260811 05:03:57.771778 31689 raft_consensus.cc:2781] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:57.772034 31689 raft_consensus.cc:686] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 LEADER]: Becoming Leader. State: Replica: 7a383a30e3c34f2082fd5d1d87338ef4, State: Running, Role: LEADER
I20260811 05:03:57.772408 31689 consensus_queue.cc:237] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } }
I20260811 05:03:57.775688 31107 catalog_manager.cc:5495] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a383a30e3c34f2082fd5d1d87338ef4 (127.22.49.195). New cstate: current_term: 1 leader_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } health_report { overall_health: UNKNOWN } } }
I20260811 05:03:57.868496 31678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.864584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35712 (local address 127.22.49.195:41113)
0811 05:03:57.864743 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:57.864747 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:57.864762 (+ 15us) server_negotiation.cc:407] Connection header received
0811 05:03:57.864843 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:57.864845 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:57.864902 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:57.864999 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:57.865278 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.865838 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.866822 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.867103 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.867193 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.867516 (+ 323us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:57.868010 (+ 494us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:57.868107 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:57.868307 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 05:03:57.868373 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 05:03:57.874926 31446 raft_consensus.cc:1261] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Refusing update from remote peer 7a383a30e3c34f2082fd5d1d87338ef4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:57.874926 31280 raft_consensus.cc:1261] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417 [term 1 FOLLOWER]: Refusing update from remote peer 7a383a30e3c34f2082fd5d1d87338ef4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:57.875749 31689 consensus_queue.cc:1035] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:57.875979 31692 consensus_queue.cc:1035] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:57.885134 31699 mvcc.cc:205] Tried to move back new op lower bound from 7317195316726734848 to 7317195316318965760. Current Snapshot: MvccSnapshot[applied={T|T < 7317195316726734848}]
I20260811 05:03:57.886384 31698 mvcc.cc:205] Tried to move back new op lower bound from 7317195316726734848 to 7317195316318965760. Current Snapshot: MvccSnapshot[applied={T|T < 7317195316726734848}]
I20260811 05:03:57.888171 31696 mvcc.cc:205] Tried to move back new op lower bound from 7317195316726734848 to 7317195316318965760. Current Snapshot: MvccSnapshot[applied={T|T < 7317195316726734848 or (T in {7317195316726734848})}]
I20260811 05:03:57.894426 31105 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:57.894614 31105 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:57.897065 31105 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287: Sending DeleteTablet for 3 replicas of tablet d4bad1e57ef24ab2be8857da47a3ba42
I20260811 05:03:57.898018 31421 tablet_service.cc:1514] Processing DeleteTablet for tablet d4bad1e57ef24ab2be8857da47a3ba42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:57 UTC) from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:53880
I20260811 05:03:57.898041 31578 tablet_service.cc:1514] Processing DeleteTablet for tablet d4bad1e57ef24ab2be8857da47a3ba42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:57 UTC) from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:35696
I20260811 05:03:57.898579 31259 tablet_service.cc:1514] Processing DeleteTablet for tablet d4bad1e57ef24ab2be8857da47a3ba42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:57 UTC) from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:60326
I20260811 05:03:57.898674 31105 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34840:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:03:57.899170 31105 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:57.899160 31709 tablet_replica.cc:330] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417: stopping tablet replica
I20260811 05:03:57.899537 31709 raft_consensus.cc:2229] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:57.899915 31709 raft_consensus.cc:2258] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:57.900339 31708 tablet_replica.cc:330] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4: stopping tablet replica
I20260811 05:03:57.900627 31708 raft_consensus.cc:2229] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:03:57.901068 31708 raft_consensus.cc:2258] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:57.902637 31708 ts_tablet_manager.cc:1905] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:57.903934 31709 ts_tablet_manager.cc:1905] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:57.904215 31707 tablet_replica.cc:330] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7: stopping tablet replica
I20260811 05:03:57.904577 31707 raft_consensus.cc:2229] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:57.904810 31421 tablet_service.cc:1467] Processing CreateTablet for tablet f25fdd0111414b7f92d357e5d03c0f4d (DEFAULT_TABLE table=test-table [id=7db809c6fecd4fb7a0a7718f9bde0903]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:57.905084 31421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f25fdd0111414b7f92d357e5d03c0f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:57.905221 31707 raft_consensus.cc:2258] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:57.905799 31708 ts_tablet_manager.cc:1918] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:57.905912 31708 log.cc:1196] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/d4bad1e57ef24ab2be8857da47a3ba42
I20260811 05:03:57.906473 31708 ts_tablet_manager.cc:1939] T d4bad1e57ef24ab2be8857da47a3ba42 P 7a383a30e3c34f2082fd5d1d87338ef4: Deleting consensus metadata
I20260811 05:03:57.907927 31684 tablet_bootstrap.cc:492] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7: Bootstrap starting.
I20260811 05:03:57.908196 31709 ts_tablet_manager.cc:1918] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:57.908310 31709 log.cc:1196] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/wal/wals/d4bad1e57ef24ab2be8857da47a3ba42
I20260811 05:03:57.908638 31709 ts_tablet_manager.cc:1939] T d4bad1e57ef24ab2be8857da47a3ba42 P 3b0ed08ad7124a59a445e1457ed54417: Deleting consensus metadata
I20260811 05:03:57.909013 31684 tablet_bootstrap.cc:654] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:57.904361 31259 tablet_service.cc:1467] Processing CreateTablet for tablet f25fdd0111414b7f92d357e5d03c0f4d (DEFAULT_TABLE table=test-table [id=7db809c6fecd4fb7a0a7718f9bde0903]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:57.909808 31259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f25fdd0111414b7f92d357e5d03c0f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:57.910429 31684 tablet_bootstrap.cc:492] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7: No bootstrap required, opened a new log
I20260811 05:03:57.910519 31684 ts_tablet_manager.cc:1397] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:57.911082 31684 raft_consensus.cc:348] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:57.911243 31684 raft_consensus.cc:374] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:57.911299 31684 raft_consensus.cc:729] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc6961b319e47e6ac72953c546d8bc7, State: Initialized, Role: FOLLOWER
I20260811 05:03:57.911432 31684 consensus_queue.cc:260] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:57.911695 31684 ts_tablet_manager.cc:1428] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:57.912118 31680 tablet_bootstrap.cc:492] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417: Bootstrap starting.
I20260811 05:03:57.912595 31094 catalog_manager.cc:4841] TS 3b0ed08ad7124a59a445e1457ed54417 (127.22.49.193:46383): tablet d4bad1e57ef24ab2be8857da47a3ba42 (table test-table [id=c8a55b11a3a4472eae76f8c39a656d88]) successfully deleted
I20260811 05:03:57.913266 31092 catalog_manager.cc:4841] TS 7a383a30e3c34f2082fd5d1d87338ef4 (127.22.49.195:41113): tablet d4bad1e57ef24ab2be8857da47a3ba42 (table test-table [id=c8a55b11a3a4472eae76f8c39a656d88]) successfully deleted
I20260811 05:03:57.913497 31680 tablet_bootstrap.cc:654] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:57.913661 31578 tablet_service.cc:1467] Processing CreateTablet for tablet f25fdd0111414b7f92d357e5d03c0f4d (DEFAULT_TABLE table=test-table [id=7db809c6fecd4fb7a0a7718f9bde0903]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:57.913949 31578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f25fdd0111414b7f92d357e5d03c0f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:57.915395 31707 ts_tablet_manager.cc:1905] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:57.916431 31682 tablet_bootstrap.cc:492] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4: Bootstrap starting.
I20260811 05:03:57.917528 31682 tablet_bootstrap.cc:654] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:57.918398 31707 ts_tablet_manager.cc:1918] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:57.918506 31707 log.cc:1196] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/d4bad1e57ef24ab2be8857da47a3ba42
I20260811 05:03:57.918908 31707 ts_tablet_manager.cc:1939] T d4bad1e57ef24ab2be8857da47a3ba42 P 2fc6961b319e47e6ac72953c546d8bc7: Deleting consensus metadata
I20260811 05:03:57.919186 31682 tablet_bootstrap.cc:492] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4: No bootstrap required, opened a new log
I20260811 05:03:57.919303 31682 ts_tablet_manager.cc:1397] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260811 05:03:57.919912 31682 raft_consensus.cc:348] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:57.920068 31682 raft_consensus.cc:374] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:57.920114 31680 tablet_bootstrap.cc:492] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417: No bootstrap required, opened a new log
I20260811 05:03:57.920115 31682 raft_consensus.cc:729] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a383a30e3c34f2082fd5d1d87338ef4, State: Initialized, Role: FOLLOWER
I20260811 05:03:57.920217 31680 ts_tablet_manager.cc:1397] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260811 05:03:57.920234 31094 catalog_manager.cc:4841] TS 2fc6961b319e47e6ac72953c546d8bc7 (127.22.49.194:43743): tablet d4bad1e57ef24ab2be8857da47a3ba42 (table test-table [id=c8a55b11a3a4472eae76f8c39a656d88]) successfully deleted
I20260811 05:03:57.920284 31682 consensus_queue.cc:260] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:57.920584 31682 ts_tablet_manager.cc:1428] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:57.920729 31680 raft_consensus.cc:348] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:57.920849 31680 raft_consensus.cc:374] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:57.920890 31680 raft_consensus.cc:729] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b0ed08ad7124a59a445e1457ed54417, State: Initialized, Role: FOLLOWER
I20260811 05:03:57.921029 31680 consensus_queue.cc:260] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:57.921315 31680 ts_tablet_manager.cc:1428] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 05:03:57.973687 31688 raft_consensus.cc:482] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:57.973874 31688 raft_consensus.cc:504] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:57.975294 31688 leader_election.cc:288] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc6961b319e47e6ac72953c546d8bc7 (127.22.49.194:43743), 7a383a30e3c34f2082fd5d1d87338ef4 (127.22.49.195:41113)
I20260811 05:03:57.980358 31679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.975925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:42335 (local address 127.22.49.194:43743)
0811 05:03:57.976064 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:57.976068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:57.976083 (+ 15us) server_negotiation.cc:407] Connection header received
0811 05:03:57.976277 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:57.976280 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:57.976343 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:57.976427 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:57.976789 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.977377 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.978857 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.979530 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.979666 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.979721 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:57.980123 (+ 402us) server_negotiation.cc:299] Negotiation successful
0811 05:03:57.980216 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 05:03:57.980376 31678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.975674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:49009 (local address 127.22.49.195:41113)
0811 05:03:57.975824 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:57.975831 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:57.976403 (+ 572us) server_negotiation.cc:407] Connection header received
0811 05:03:57.976580 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:57.976583 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:57.976628 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:57.976700 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:57.976991 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.977730 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.979081 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.979629 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.979746 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.979810 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:57.980160 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 05:03:57.980244 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 05:03:57.980786 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.975577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:43743 (local address 127.22.49.193:42335)
0811 05:03:57.975989 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:57.976005 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:57.976122 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:57.976476 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:57.976482 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:57.976499 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:57.976638 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.976643 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.977498 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.977500 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.978711 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.978722 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.979818 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.979822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.979940 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.979991 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 05:03:57.980524 (+ 533us) client_negotiation.cc:240] Negotiation successful
0811 05:03:57.980611 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"mutex_wait_us":14,"thread_start_us":91,"threads_started":1}
I20260811 05:03:57.980932 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:57.975577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:41113 (local address 127.22.49.193:49009)
0811 05:03:57.976282 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:57.976325 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:57.976439 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:57.976733 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:57.976739 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:57.976759 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:57.976877 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.976883 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.977869 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.977873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.978945 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:57.978952 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:57.979877 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:57.979882 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:57.980006 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:57.980036 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 05:03:57.980622 (+ 586us) client_negotiation.cc:240] Negotiation successful
0811 05:03:57.980705 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"mutex_wait_us":164,"thread_start_us":91,"threads_started":1}
I20260811 05:03:57.981339 31446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f25fdd0111414b7f92d357e5d03c0f4d" candidate_uuid: "3b0ed08ad7124a59a445e1457ed54417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc6961b319e47e6ac72953c546d8bc7" is_pre_election: true
I20260811 05:03:57.981532 31446 raft_consensus.cc:2454] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b0ed08ad7124a59a445e1457ed54417 in term 0.
I20260811 05:03:57.981536 31599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f25fdd0111414b7f92d357e5d03c0f4d" candidate_uuid: "3b0ed08ad7124a59a445e1457ed54417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" is_pre_election: true
I20260811 05:03:57.981791 31599 raft_consensus.cc:2454] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b0ed08ad7124a59a445e1457ed54417 in term 0.
I20260811 05:03:57.981951 31206 leader_election.cc:302] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc6961b319e47e6ac72953c546d8bc7, 3b0ed08ad7124a59a445e1457ed54417; no voters:
I20260811 05:03:57.982235 31688 raft_consensus.cc:2781] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:57.982306 31688 raft_consensus.cc:482] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:57.982345 31688 raft_consensus.cc:3037] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:57.983628 31688 raft_consensus.cc:504] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:57.984071 31688 leader_election.cc:288] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [CANDIDATE]: Term 1 election: Requested vote from peers 2fc6961b319e47e6ac72953c546d8bc7 (127.22.49.194:43743), 7a383a30e3c34f2082fd5d1d87338ef4 (127.22.49.195:41113)
I20260811 05:03:57.984405 31446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f25fdd0111414b7f92d357e5d03c0f4d" candidate_uuid: "3b0ed08ad7124a59a445e1457ed54417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc6961b319e47e6ac72953c546d8bc7"
I20260811 05:03:57.984423 31599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f25fdd0111414b7f92d357e5d03c0f4d" candidate_uuid: "3b0ed08ad7124a59a445e1457ed54417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a383a30e3c34f2082fd5d1d87338ef4"
I20260811 05:03:57.984556 31599 raft_consensus.cc:3037] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:57.984535 31446 raft_consensus.cc:3037] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:57.985538 31599 raft_consensus.cc:2454] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b0ed08ad7124a59a445e1457ed54417 in term 1.
I20260811 05:03:57.985730 31446 raft_consensus.cc:2454] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b0ed08ad7124a59a445e1457ed54417 in term 1.
I20260811 05:03:57.985843 31204 leader_election.cc:302] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b0ed08ad7124a59a445e1457ed54417, 7a383a30e3c34f2082fd5d1d87338ef4; no voters:
I20260811 05:03:57.986032 31688 raft_consensus.cc:2781] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:57.986271 31688 raft_consensus.cc:686] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [term 1 LEADER]: Becoming Leader. State: Replica: 3b0ed08ad7124a59a445e1457ed54417, State: Running, Role: LEADER
I20260811 05:03:57.986711 31688 consensus_queue.cc:237] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:57.989200 31106 catalog_manager.cc:5495] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b0ed08ad7124a59a445e1457ed54417 (127.22.49.193). New cstate: current_term: 1 leader_uuid: "3b0ed08ad7124a59a445e1457ed54417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } health_report { overall_health: UNKNOWN } } }
Aug 11 05:03:58 dist-test-slave-w206 krb5kdc[31060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424636, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.254@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
I20260811 05:03:58.035880 31725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:58.024894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35527 (local address 127.0.0.1:34852)
0811 05:03:58.025306 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:58.025325 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:58.025463 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:58.025821 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:58.025824 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:58.026384 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:03:58.026505 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:58.026513 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.027530 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.027534 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:58.028402 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:58.028414 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.028933 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.028937 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:58.029036 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:58.029688 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:03:58.029703 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:03:58.031659 (+ 1956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:03:58.033939 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:58.033948 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:58.033954 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:58.034201 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:58.034576 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:03:58.034578 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:03:58.034579 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:03:58.034662 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:03:58.035226 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:03:58.035232 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:03:58.035360 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 05:03:58.035487 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 05:03:58.035665 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":152,"threads_started":1}
I20260811 05:03:58.035912 31726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:58.025025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34852 (local address 127.22.49.254:35527)
0811 05:03:58.025312 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:58.025324 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:58.025447 (+ 123us) server_negotiation.cc:407] Connection header received
0811 05:03:58.025605 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:58.025608 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:58.025659 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:58.025769 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:58.026645 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.027400 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.028539 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.028793 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.028895 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:58.031831 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:58.031835 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:58.031839 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:58.031874 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:58.033752 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:58.034310 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:58.034314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:58.034316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:58.034419 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:58.034763 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:58.034768 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:58.034773 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:58.035077 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:58.035178 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:58.035567 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 05:03:58.035765 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":78,"threads_started":1}
I20260811 05:03:58.040567 31106 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:34852:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 05:03:58.041428 31106 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:58.047040 31259 tablet_service.cc:1467] Processing CreateTablet for tablet 6807c554005540af8bff405a0e75768f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6a4302460e564365824c2a4e4bc576ff]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:03:58.047093 31421 tablet_service.cc:1467] Processing CreateTablet for tablet 6807c554005540af8bff405a0e75768f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6a4302460e564365824c2a4e4bc576ff]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:03:58.047485 31259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6807c554005540af8bff405a0e75768f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:58.047497 31421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6807c554005540af8bff405a0e75768f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:58.049940 31680 tablet_bootstrap.cc:492] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417: Bootstrap starting.
I20260811 05:03:58.050712 31578 tablet_service.cc:1467] Processing CreateTablet for tablet 6807c554005540af8bff405a0e75768f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6a4302460e564365824c2a4e4bc576ff]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 05:03:58.051033 31680 tablet_bootstrap.cc:654] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:58.051134 31578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6807c554005540af8bff405a0e75768f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:58.052248 31680 tablet_bootstrap.cc:492] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417: No bootstrap required, opened a new log
I20260811 05:03:58.052361 31680 ts_tablet_manager.cc:1397] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 05:03:58.052857 31680 raft_consensus.cc:348] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.052982 31680 raft_consensus.cc:374] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:58.053030 31680 raft_consensus.cc:729] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b0ed08ad7124a59a445e1457ed54417, State: Initialized, Role: FOLLOWER
I20260811 05:03:58.053202 31680 consensus_queue.cc:260] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.053468 31688 tablet_replica.cc:439] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } }
I20260811 05:03:58.053644 31688 tablet_replica.cc:442] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:58.053880 31680 ts_tablet_manager.cc:1428] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 05:03:58.054116 31684 tablet_bootstrap.cc:492] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7: Bootstrap starting.
I20260811 05:03:58.055203 31684 tablet_bootstrap.cc:654] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:58.055892 31682 tablet_bootstrap.cc:492] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4: Bootstrap starting.
I20260811 05:03:58.056377 31684 tablet_bootstrap.cc:492] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7: No bootstrap required, opened a new log
I20260811 05:03:58.056453 31684 ts_tablet_manager.cc:1397] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 05:03:58.056900 31684 raft_consensus.cc:348] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.057009 31684 raft_consensus.cc:374] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:58.057039 31684 raft_consensus.cc:729] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc6961b319e47e6ac72953c546d8bc7, State: Initialized, Role: FOLLOWER
I20260811 05:03:58.057163 31684 consensus_queue.cc:260] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.057401 31684 ts_tablet_manager.cc:1428] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:58.057564 31682 tablet_bootstrap.cc:654] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:58.057621 31690 tablet_replica.cc:439] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } }
I20260811 05:03:58.057753 31690 tablet_replica.cc:442] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:58.059476 31682 tablet_bootstrap.cc:492] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4: No bootstrap required, opened a new log
I20260811 05:03:58.059588 31682 ts_tablet_manager.cc:1397] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 05:03:58.060127 31682 raft_consensus.cc:348] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.060246 31682 raft_consensus.cc:374] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:58.060273 31682 raft_consensus.cc:729] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a383a30e3c34f2082fd5d1d87338ef4, State: Initialized, Role: FOLLOWER
I20260811 05:03:58.060459 31682 consensus_queue.cc:260] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.060801 31682 ts_tablet_manager.cc:1428] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 05:03:58.060720 31689 tablet_replica.cc:439] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } }
I20260811 05:03:58.060897 31689 tablet_replica.cc:442] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:58.124336 31688 raft_consensus.cc:482] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:58.124518 31688 raft_consensus.cc:504] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.125000 31688 leader_election.cc:288] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc6961b319e47e6ac72953c546d8bc7 (127.22.49.194:43743), 7a383a30e3c34f2082fd5d1d87338ef4 (127.22.49.195:41113)
I20260811 05:03:58.125689 31599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6807c554005540af8bff405a0e75768f" candidate_uuid: "3b0ed08ad7124a59a445e1457ed54417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" is_pre_election: true
I20260811 05:03:58.125689 31446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6807c554005540af8bff405a0e75768f" candidate_uuid: "3b0ed08ad7124a59a445e1457ed54417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc6961b319e47e6ac72953c546d8bc7" is_pre_election: true
I20260811 05:03:58.125878 31446 raft_consensus.cc:2454] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b0ed08ad7124a59a445e1457ed54417 in term 0.
I20260811 05:03:58.125877 31599 raft_consensus.cc:2454] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b0ed08ad7124a59a445e1457ed54417 in term 0.
I20260811 05:03:58.126250 31206 leader_election.cc:302] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2fc6961b319e47e6ac72953c546d8bc7, 3b0ed08ad7124a59a445e1457ed54417, 7a383a30e3c34f2082fd5d1d87338ef4; no voters:
I20260811 05:03:58.126547 31688 raft_consensus.cc:2781] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:58.126631 31688 raft_consensus.cc:482] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:58.126688 31688 raft_consensus.cc:3037] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:58.128127 31688 raft_consensus.cc:504] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.128688 31688 leader_election.cc:288] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [CANDIDATE]: Term 1 election: Requested vote from peers 2fc6961b319e47e6ac72953c546d8bc7 (127.22.49.194:43743), 7a383a30e3c34f2082fd5d1d87338ef4 (127.22.49.195:41113)
I20260811 05:03:58.129163 31599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6807c554005540af8bff405a0e75768f" candidate_uuid: "3b0ed08ad7124a59a445e1457ed54417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a383a30e3c34f2082fd5d1d87338ef4"
I20260811 05:03:58.129385 31599 raft_consensus.cc:3037] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:58.129640 31446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6807c554005540af8bff405a0e75768f" candidate_uuid: "3b0ed08ad7124a59a445e1457ed54417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc6961b319e47e6ac72953c546d8bc7"
I20260811 05:03:58.129802 31446 raft_consensus.cc:3037] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:58.130769 31599 raft_consensus.cc:2454] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b0ed08ad7124a59a445e1457ed54417 in term 1.
I20260811 05:03:58.131083 31446 raft_consensus.cc:2454] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b0ed08ad7124a59a445e1457ed54417 in term 1.
I20260811 05:03:58.131153 31204 leader_election.cc:302] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b0ed08ad7124a59a445e1457ed54417, 7a383a30e3c34f2082fd5d1d87338ef4; no voters:
I20260811 05:03:58.131381 31688 raft_consensus.cc:2781] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:58.131932 31688 raft_consensus.cc:686] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [term 1 LEADER]: Becoming Leader. State: Replica: 3b0ed08ad7124a59a445e1457ed54417, State: Running, Role: LEADER
I20260811 05:03:58.132122 31688 consensus_queue.cc:237] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.133337 31715 tablet_replica.cc:439] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417: TxnStatusTablet state changed. Reason: New leader 3b0ed08ad7124a59a445e1457ed54417. Latest consensus state: current_term: 1 leader_uuid: "3b0ed08ad7124a59a445e1457ed54417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } }
I20260811 05:03:58.133531 31715 tablet_replica.cc:442] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:03:58.134414 31731 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 05:03:58.134600 31731 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 05:03:58.135144 31106 catalog_manager.cc:5495] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b0ed08ad7124a59a445e1457ed54417 (127.22.49.193). New cstate: current_term: 1 leader_uuid: "3b0ed08ad7124a59a445e1457ed54417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } health_report { overall_health: UNKNOWN } } }
I20260811 05:03:58.167044 31725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:58.161937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:46383 (local address 127.0.0.1:60338)
0811 05:03:58.162114 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:58.162134 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:58.162265 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:58.162713 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:58.162718 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:58.162727 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:03:58.162899 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:58.162909 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.163774 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.163780 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:58.164922 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:58.164934 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.165475 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.165479 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:58.165615 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:58.165692 (+ 77us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:03:58.166518 (+ 826us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:03:58.166541 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 05:03:58.166619 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 05:03:58.166766 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 05:03:58.167511 31676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:58.162065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60338 (local address 127.22.49.193:46383)
0811 05:03:58.162208 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:58.162214 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:58.162234 (+ 20us) server_negotiation.cc:407] Connection header received
0811 05:03:58.162454 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:58.162457 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:58.162533 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:58.162670 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:58.163053 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.163637 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.165057 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.165327 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.165467 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:58.165883 (+ 416us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:58.166406 (+ 523us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:58.166548 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:58.167299 (+ 751us) server_negotiation.cc:299] Negotiation successful
0811 05:03:58.167367 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 05:03:58.171499 31599 raft_consensus.cc:1261] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Refusing update from remote peer 3b0ed08ad7124a59a445e1457ed54417: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:58.172226 31688 consensus_queue.cc:1035] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:58.172407 31446 raft_consensus.cc:1261] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Refusing update from remote peer 3b0ed08ad7124a59a445e1457ed54417: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:58.172902 31688 consensus_queue.cc:1035] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:58.174490 31689 tablet_replica.cc:439] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4: TxnStatusTablet state changed. Reason: New leader 3b0ed08ad7124a59a445e1457ed54417. Latest consensus state: current_term: 1 leader_uuid: "3b0ed08ad7124a59a445e1457ed54417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } }
I20260811 05:03:58.174631 31689 tablet_replica.cc:442] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:58.176512 31690 tablet_replica.cc:439] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7: TxnStatusTablet state changed. Reason: New leader 3b0ed08ad7124a59a445e1457ed54417. Latest consensus state: current_term: 1 leader_uuid: "3b0ed08ad7124a59a445e1457ed54417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } }
I20260811 05:03:58.176648 31690 tablet_replica.cc:442] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:58.177644 31715 tablet_replica.cc:439] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3b0ed08ad7124a59a445e1457ed54417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } }
I20260811 05:03:58.177800 31715 tablet_replica.cc:442] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:03:58.182034 31689 tablet_replica.cc:439] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3b0ed08ad7124a59a445e1457ed54417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } }
I20260811 05:03:58.182200 31689 tablet_replica.cc:442] T 6807c554005540af8bff405a0e75768f P 7a383a30e3c34f2082fd5d1d87338ef4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:58.183446 31688 tablet_replica.cc:439] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3b0ed08ad7124a59a445e1457ed54417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } }
I20260811 05:03:58.183573 31688 tablet_replica.cc:442] T 6807c554005540af8bff405a0e75768f P 3b0ed08ad7124a59a445e1457ed54417: This TxnStatusTablet replica's current role is: LEADER
I20260811 05:03:58.186666 31690 tablet_replica.cc:439] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3b0ed08ad7124a59a445e1457ed54417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } } }
I20260811 05:03:58.186810 31690 tablet_replica.cc:442] T 6807c554005540af8bff405a0e75768f P 2fc6961b319e47e6ac72953c546d8bc7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 05:03:58.188787 31676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:58.184097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60354 (local address 127.22.49.193:46383)
0811 05:03:58.184211 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:58.184218 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:58.184246 (+ 28us) server_negotiation.cc:407] Connection header received
0811 05:03:58.184399 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:58.184402 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:58.184457 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:58.184532 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:58.184966 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.185785 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.187058 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.187481 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.187585 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:58.188037 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:58.188152 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:58.188228 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:58.188570 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 05:03:58.188645 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 05:03:58.201424 31676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:58.197325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:59443 (local address 127.22.49.193:46383)
0811 05:03:58.197762 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:58.197767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:58.197877 (+ 110us) server_negotiation.cc:407] Connection header received
0811 05:03:58.198071 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:58.198074 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:58.198127 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:58.198200 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:58.198515 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.199261 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.200244 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.200469 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.200581 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:58.200883 (+ 302us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:58.200962 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:58.201045 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:58.201140 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 05:03:58.201219 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":369}
I20260811 05:03:58.201435 31740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:58.197263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:46383 (local address 127.22.49.193:59443)
0811 05:03:58.197780 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:58.197799 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:58.197960 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:58.198206 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:58.198256 (+ 50us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:58.198266 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:03:58.198406 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:58.198412 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.199365 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.199372 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:58.200105 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:58.200115 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.200586 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.200589 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:58.200695 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:58.200745 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:03:58.201046 (+ 301us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:03:58.201053 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 05:03:58.201122 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 05:03:58.201227 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"mutex_wait_us":6,"thread_start_us":210,"threads_started":1}
I20260811 05:03:58.209282 31599 raft_consensus.cc:1261] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Refusing update from remote peer 3b0ed08ad7124a59a445e1457ed54417: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:58.209395 31446 raft_consensus.cc:1261] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Refusing update from remote peer 3b0ed08ad7124a59a445e1457ed54417: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:58.209764 31715 consensus_queue.cc:1035] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:58.209980 31688 consensus_queue.cc:1035] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:58.260078 31107 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:58.260252 31107 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:58.262622 31107 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287: Sending DeleteTablet for 3 replicas of tablet f25fdd0111414b7f92d357e5d03c0f4d
I20260811 05:03:58.263435 31421 tablet_service.cc:1514] Processing DeleteTablet for tablet f25fdd0111414b7f92d357e5d03c0f4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:58 UTC) from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:53880
I20260811 05:03:58.263531 31578 tablet_service.cc:1514] Processing DeleteTablet for tablet f25fdd0111414b7f92d357e5d03c0f4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:58 UTC) from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:35696
I20260811 05:03:58.263691 31707 tablet_replica.cc:330] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7: stopping tablet replica
I20260811 05:03:58.263722 31708 tablet_replica.cc:330] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4: stopping tablet replica
I20260811 05:03:58.263715 31259 tablet_service.cc:1514] Processing DeleteTablet for tablet f25fdd0111414b7f92d357e5d03c0f4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:58 UTC) from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:60326
I20260811 05:03:58.263844 31707 raft_consensus.cc:2229] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:58.263873 31708 raft_consensus.cc:2229] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:58.263913 31709 tablet_replica.cc:330] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417: stopping tablet replica
I20260811 05:03:58.263983 31707 raft_consensus.cc:2258] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:58.264006 31708 raft_consensus.cc:2258] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:58.264019 31709 raft_consensus.cc:2229] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:03:58.264380 31709 raft_consensus.cc:2258] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:58.265264 31709 ts_tablet_manager.cc:1905] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:58.269112 31709 ts_tablet_manager.cc:1918] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:03:58.269214 31709 log.cc:1196] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/wal/wals/f25fdd0111414b7f92d357e5d03c0f4d
I20260811 05:03:58.269546 31709 ts_tablet_manager.cc:1939] T f25fdd0111414b7f92d357e5d03c0f4d P 3b0ed08ad7124a59a445e1457ed54417: Deleting consensus metadata
I20260811 05:03:58.270509 31707 ts_tablet_manager.cc:1905] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:58.271147 31094 catalog_manager.cc:4841] TS 3b0ed08ad7124a59a445e1457ed54417 (127.22.49.193:46383): tablet f25fdd0111414b7f92d357e5d03c0f4d (table test-table [id=7db809c6fecd4fb7a0a7718f9bde0903]) successfully deleted
I20260811 05:03:58.272142 31708 ts_tablet_manager.cc:1905] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:58.273797 31707 ts_tablet_manager.cc:1918] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:03:58.273905 31707 log.cc:1196] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/f25fdd0111414b7f92d357e5d03c0f4d
I20260811 05:03:58.274215 31707 ts_tablet_manager.cc:1939] T f25fdd0111414b7f92d357e5d03c0f4d P 2fc6961b319e47e6ac72953c546d8bc7: Deleting consensus metadata
I20260811 05:03:58.275121 31094 catalog_manager.cc:4841] TS 2fc6961b319e47e6ac72953c546d8bc7 (127.22.49.194:43743): tablet f25fdd0111414b7f92d357e5d03c0f4d (table test-table [id=7db809c6fecd4fb7a0a7718f9bde0903]) successfully deleted
I20260811 05:03:58.275280 31708 ts_tablet_manager.cc:1918] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:03:58.275368 31708 log.cc:1196] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/f25fdd0111414b7f92d357e5d03c0f4d
I20260811 05:03:58.275629 31708 ts_tablet_manager.cc:1939] T f25fdd0111414b7f92d357e5d03c0f4d P 7a383a30e3c34f2082fd5d1d87338ef4: Deleting consensus metadata
I20260811 05:03:58.276957 31092 catalog_manager.cc:4841] TS 7a383a30e3c34f2082fd5d1d87338ef4 (127.22.49.195:41113): tablet f25fdd0111414b7f92d357e5d03c0f4d (table test-table [id=7db809c6fecd4fb7a0a7718f9bde0903]) successfully deleted
Aug 11 05:03:58 dist-test-slave-w206 krb5kdc[31060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 05:03:58 dist-test-slave-w206 krb5kdc[31060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:03:58 dist-test-slave-w206 krb5kdc[31060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 05:03:58.300321 31726 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:03:58.292771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34858 (local address 127.22.49.254:35527)
0811 05:03:58.292934 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:58.292940 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:58.293064 (+ 124us) server_negotiation.cc:407] Connection header received
0811 05:03:58.293190 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:58.293194 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:58.293252 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:58.293353 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:58.294083 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.295072 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.295933 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.296328 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.296455 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:58.300176 (+ 3721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34858: BlockingRecv error: recv got EOF from 127.0.0.1:34858 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 05:03:58 dist-test-slave-w206 krb5kdc[31060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM
I20260811 05:03:58.312801 31726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:58.302270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34868 (local address 127.22.49.254:35527)
0811 05:03:58.302413 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:58.302417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:58.302549 (+ 132us) server_negotiation.cc:407] Connection header received
0811 05:03:58.302647 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:58.302650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:58.302704 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:58.302814 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:03:58.303504 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.304403 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.305178 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.305558 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.305680 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:58.308567 (+ 2887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:03:58.308574 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:03:58.308578 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:03:58.308625 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:03:58.310635 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:58.311306 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:58.311310 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:58.311312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:58.311426 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:03:58.311724 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:03:58.311727 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:03:58.311730 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:03:58.312013 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:03:58.312165 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:58.312436 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 05:03:58.312589 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 05:03:58.315745 31107 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34868:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:03:58.316241 31107 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:58.321650 31259 tablet_service.cc:1467] Processing CreateTablet for tablet 7c0da746f7fb4375b417e5b81bd4739a (DEFAULT_TABLE table=test-table [id=cc1886756cb6477781fc3411169b502c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:58.321703 31578 tablet_service.cc:1467] Processing CreateTablet for tablet 7c0da746f7fb4375b417e5b81bd4739a (DEFAULT_TABLE table=test-table [id=cc1886756cb6477781fc3411169b502c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:58.321666 31421 tablet_service.cc:1467] Processing CreateTablet for tablet 7c0da746f7fb4375b417e5b81bd4739a (DEFAULT_TABLE table=test-table [id=cc1886756cb6477781fc3411169b502c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:58.322003 31259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c0da746f7fb4375b417e5b81bd4739a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:58.322003 31578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c0da746f7fb4375b417e5b81bd4739a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:58.322031 31421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c0da746f7fb4375b417e5b81bd4739a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:58.324676 31682 tablet_bootstrap.cc:492] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4: Bootstrap starting.
I20260811 05:03:58.324908 31680 tablet_bootstrap.cc:492] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417: Bootstrap starting.
I20260811 05:03:58.324934 31684 tablet_bootstrap.cc:492] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7: Bootstrap starting.
I20260811 05:03:58.325659 31682 tablet_bootstrap.cc:654] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:58.325883 31680 tablet_bootstrap.cc:654] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:58.326028 31684 tablet_bootstrap.cc:654] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:58.327630 31684 tablet_bootstrap.cc:492] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7: No bootstrap required, opened a new log
I20260811 05:03:58.327769 31684 ts_tablet_manager.cc:1397] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:03:58.328305 31684 raft_consensus.cc:348] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.328455 31684 raft_consensus.cc:374] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:58.328505 31684 raft_consensus.cc:729] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc6961b319e47e6ac72953c546d8bc7, State: Initialized, Role: FOLLOWER
I20260811 05:03:58.328694 31684 consensus_queue.cc:260] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.331486 31684 ts_tablet_manager.cc:1428] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 05:03:58.332404 31682 tablet_bootstrap.cc:492] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4: No bootstrap required, opened a new log
I20260811 05:03:58.332422 31680 tablet_bootstrap.cc:492] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417: No bootstrap required, opened a new log
I20260811 05:03:58.332512 31680 ts_tablet_manager.cc:1397] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260811 05:03:58.332512 31682 ts_tablet_manager.cc:1397] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260811 05:03:58.333067 31680 raft_consensus.cc:348] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.333214 31680 raft_consensus.cc:374] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:58.333257 31680 raft_consensus.cc:729] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b0ed08ad7124a59a445e1457ed54417, State: Initialized, Role: FOLLOWER
I20260811 05:03:58.333427 31680 consensus_queue.cc:260] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.333720 31680 ts_tablet_manager.cc:1428] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 05:03:58.334079 31682 raft_consensus.cc:348] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.334196 31682 raft_consensus.cc:374] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:58.334235 31682 raft_consensus.cc:729] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a383a30e3c34f2082fd5d1d87338ef4, State: Initialized, Role: FOLLOWER
I20260811 05:03:58.334381 31682 consensus_queue.cc:260] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.335441 31682 ts_tablet_manager.cc:1428] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260811 05:03:58.475962 31690 raft_consensus.cc:482] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:58.476148 31690 raft_consensus.cc:504] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.477293 31690 leader_election.cc:288] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b0ed08ad7124a59a445e1457ed54417 (127.22.49.193:46383), 7a383a30e3c34f2082fd5d1d87338ef4 (127.22.49.195:41113)
I20260811 05:03:58.482462 31678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:58.477673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:58919 (local address 127.22.49.195:41113)
0811 05:03:58.477807 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:58.477813 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:58.478116 (+ 303us) server_negotiation.cc:407] Connection header received
0811 05:03:58.478275 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:58.478278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:58.478348 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:58.478436 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:58.479270 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.479762 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.481172 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.481815 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.481996 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:58.482069 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:58.482216 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 05:03:58.482300 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 05:03:58.482457 31763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:58.477579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:41113 (local address 127.22.49.194:58919)
0811 05:03:58.477988 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:58.478004 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:58.478141 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:58.478473 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:58.478475 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:58.478491 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:58.479126 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:58.479139 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.479896 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.479900 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:58.480994 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:58.481007 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.481976 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.481980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:58.482086 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:58.482114 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 05:03:58.482200 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 05:03:58.482287 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":73,"threads_started":1}
I20260811 05:03:58.482643 31676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:58.477776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:41895 (local address 127.22.49.193:46383)
0811 05:03:58.477918 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:58.477923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:58.478310 (+ 387us) server_negotiation.cc:407] Connection header received
0811 05:03:58.478446 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:58.478451 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:58.478501 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:58.478578 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:03:58.478911 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.479710 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.481277 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.481909 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.482017 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:58.482069 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:58.482439 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 05:03:58.482528 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 05:03:58.483214 31597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c0da746f7fb4375b417e5b81bd4739a" candidate_uuid: "2fc6961b319e47e6ac72953c546d8bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" is_pre_election: true
I20260811 05:03:58.483307 31764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:58.477583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:46383 (local address 127.22.49.194:41895)
0811 05:03:58.478209 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:58.478222 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:58.478330 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:58.478602 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:58.478606 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:58.478627 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:03:58.478760 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:58.478768 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.479907 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.479910 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:58.481144 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:58.481156 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.482135 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.482139 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:58.482285 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:58.482308 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 05:03:58.483025 (+ 717us) client_negotiation.cc:240] Negotiation successful
0811 05:03:58.483157 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":203,"thread_start_us":136,"threads_started":1}
I20260811 05:03:58.483394 31597 raft_consensus.cc:2454] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc6961b319e47e6ac72953c546d8bc7 in term 0.
I20260811 05:03:58.483814 31280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c0da746f7fb4375b417e5b81bd4739a" candidate_uuid: "2fc6961b319e47e6ac72953c546d8bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b0ed08ad7124a59a445e1457ed54417" is_pre_election: true
I20260811 05:03:58.483930 31280 raft_consensus.cc:2454] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc6961b319e47e6ac72953c546d8bc7 in term 0.
I20260811 05:03:58.484341 31366 leader_election.cc:302] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc6961b319e47e6ac72953c546d8bc7, 3b0ed08ad7124a59a445e1457ed54417; no voters:
I20260811 05:03:58.484675 31690 raft_consensus.cc:2781] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:58.484735 31690 raft_consensus.cc:482] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:58.484773 31690 raft_consensus.cc:3037] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:58.485798 31690 raft_consensus.cc:504] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.486152 31690 leader_election.cc:288] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [CANDIDATE]: Term 1 election: Requested vote from peers 3b0ed08ad7124a59a445e1457ed54417 (127.22.49.193:46383), 7a383a30e3c34f2082fd5d1d87338ef4 (127.22.49.195:41113)
I20260811 05:03:58.486624 31280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c0da746f7fb4375b417e5b81bd4739a" candidate_uuid: "2fc6961b319e47e6ac72953c546d8bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b0ed08ad7124a59a445e1457ed54417"
I20260811 05:03:58.486754 31280 raft_consensus.cc:3037] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:58.486768 31597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c0da746f7fb4375b417e5b81bd4739a" candidate_uuid: "2fc6961b319e47e6ac72953c546d8bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a383a30e3c34f2082fd5d1d87338ef4"
I20260811 05:03:58.486884 31597 raft_consensus.cc:3037] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:58.488111 31280 raft_consensus.cc:2454] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc6961b319e47e6ac72953c546d8bc7 in term 1.
I20260811 05:03:58.488221 31597 raft_consensus.cc:2454] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc6961b319e47e6ac72953c546d8bc7 in term 1.
I20260811 05:03:58.488567 31366 leader_election.cc:302] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc6961b319e47e6ac72953c546d8bc7, 3b0ed08ad7124a59a445e1457ed54417; no voters:
I20260811 05:03:58.488786 31690 raft_consensus.cc:2781] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:58.489073 31690 raft_consensus.cc:686] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc6961b319e47e6ac72953c546d8bc7, State: Running, Role: LEADER
I20260811 05:03:58.489351 31690 consensus_queue.cc:237] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.492093 31107 catalog_manager.cc:5495] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc6961b319e47e6ac72953c546d8bc7 (127.22.49.194). New cstate: current_term: 1 leader_uuid: "2fc6961b319e47e6ac72953c546d8bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } health_report { overall_health: UNKNOWN } } }
I20260811 05:03:58.537164 31768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:58.533154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53894 (local address 127.22.49.194:43743)
0811 05:03:58.533555 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:58.533562 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:58.533574 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:03:58.533653 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:58.533655 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:58.533710 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:58.533814 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:58.534087 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.534768 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.535652 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:58.535904 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:58.535988 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:58.536208 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:58.536729 (+ 521us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:58.536820 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:58.536888 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 05:03:58.536942 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":113,"threads_started":1}
I20260811 05:03:58.540019 31597 raft_consensus.cc:1261] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Refusing update from remote peer 2fc6961b319e47e6ac72953c546d8bc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:58.540061 31280 raft_consensus.cc:1261] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417 [term 1 FOLLOWER]: Refusing update from remote peer 2fc6961b319e47e6ac72953c546d8bc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:58.540628 31765 consensus_queue.cc:1035] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:58.540858 31690 consensus_queue.cc:1035] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:58.552248 31107 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:58.552428 31107 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:58.554606 31107 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287: Sending DeleteTablet for 3 replicas of tablet 7c0da746f7fb4375b417e5b81bd4739a
I20260811 05:03:58.555342 31259 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c0da746f7fb4375b417e5b81bd4739a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:58 UTC) from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:60326
I20260811 05:03:58.555569 31709 tablet_replica.cc:330] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417: stopping tablet replica
I20260811 05:03:58.555616 31578 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c0da746f7fb4375b417e5b81bd4739a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:58 UTC) from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:35696
I20260811 05:03:58.555711 31709 raft_consensus.cc:2229] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:58.555816 31708 tablet_replica.cc:330] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4: stopping tablet replica
I20260811 05:03:58.555864 31709 raft_consensus.cc:2258] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:58.555971 31708 raft_consensus.cc:2229] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:58.556010 31421 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c0da746f7fb4375b417e5b81bd4739a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:58 UTC) from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:53880
I20260811 05:03:58.556116 31708 raft_consensus.cc:2258] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:58.556182 31707 tablet_replica.cc:330] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7: stopping tablet replica
I20260811 05:03:58.556288 31707 raft_consensus.cc:2229] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:03:58.556643 31707 raft_consensus.cc:2258] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:58.556994 31708 ts_tablet_manager.cc:1905] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:58.557371 31707 ts_tablet_manager.cc:1905] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:58.559494 31107 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34868:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 05:03:58.559935 31708 ts_tablet_manager.cc:1918] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:58.560025 31708 log.cc:1196] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/7c0da746f7fb4375b417e5b81bd4739a
W20260811 05:03:58.560052 31107 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:03:58.560148 31707 ts_tablet_manager.cc:1918] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:58.560227 31707 log.cc:1196] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/7c0da746f7fb4375b417e5b81bd4739a
I20260811 05:03:58.560318 31708 ts_tablet_manager.cc:1939] T 7c0da746f7fb4375b417e5b81bd4739a P 7a383a30e3c34f2082fd5d1d87338ef4: Deleting consensus metadata
I20260811 05:03:58.560503 31707 ts_tablet_manager.cc:1939] T 7c0da746f7fb4375b417e5b81bd4739a P 2fc6961b319e47e6ac72953c546d8bc7: Deleting consensus metadata
I20260811 05:03:58.561158 31092 catalog_manager.cc:4841] TS 7a383a30e3c34f2082fd5d1d87338ef4 (127.22.49.195:41113): tablet 7c0da746f7fb4375b417e5b81bd4739a (table test-table [id=cc1886756cb6477781fc3411169b502c]) successfully deleted
I20260811 05:03:58.561707 31094 catalog_manager.cc:4841] TS 2fc6961b319e47e6ac72953c546d8bc7 (127.22.49.194:43743): tablet 7c0da746f7fb4375b417e5b81bd4739a (table test-table [id=cc1886756cb6477781fc3411169b502c]) successfully deleted
I20260811 05:03:58.562405 31709 ts_tablet_manager.cc:1905] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:58.565043 31709 ts_tablet_manager.cc:1918] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:03:58.565142 31709 log.cc:1196] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-0/wal/wals/7c0da746f7fb4375b417e5b81bd4739a
I20260811 05:03:58.565410 31709 ts_tablet_manager.cc:1939] T 7c0da746f7fb4375b417e5b81bd4739a P 3b0ed08ad7124a59a445e1457ed54417: Deleting consensus metadata
I20260811 05:03:58.566174 31094 catalog_manager.cc:4841] TS 3b0ed08ad7124a59a445e1457ed54417 (127.22.49.193:46383): tablet 7c0da746f7fb4375b417e5b81bd4739a (table test-table [id=cc1886756cb6477781fc3411169b502c]) successfully deleted
I20260811 05:03:58.567588 31259 tablet_service.cc:1467] Processing CreateTablet for tablet fc70939aa67d4f6983d2415b85316017 (DEFAULT_TABLE table=test-table [id=495f197b7b1a4cd79e830837db6b1dd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:58.567590 31421 tablet_service.cc:1467] Processing CreateTablet for tablet fc70939aa67d4f6983d2415b85316017 (DEFAULT_TABLE table=test-table [id=495f197b7b1a4cd79e830837db6b1dd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:58.567890 31259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc70939aa67d4f6983d2415b85316017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:58.567895 31421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc70939aa67d4f6983d2415b85316017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:58.569917 31680 tablet_bootstrap.cc:492] T fc70939aa67d4f6983d2415b85316017 P 3b0ed08ad7124a59a445e1457ed54417: Bootstrap starting.
I20260811 05:03:58.570205 31578 tablet_service.cc:1467] Processing CreateTablet for tablet fc70939aa67d4f6983d2415b85316017 (DEFAULT_TABLE table=test-table [id=495f197b7b1a4cd79e830837db6b1dd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:03:58.570479 31578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc70939aa67d4f6983d2415b85316017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:03:58.570694 31684 tablet_bootstrap.cc:492] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7: Bootstrap starting.
I20260811 05:03:58.570827 31680 tablet_bootstrap.cc:654] T fc70939aa67d4f6983d2415b85316017 P 3b0ed08ad7124a59a445e1457ed54417: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:58.571623 31684 tablet_bootstrap.cc:654] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:58.572899 31684 tablet_bootstrap.cc:492] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7: No bootstrap required, opened a new log
I20260811 05:03:58.572981 31684 ts_tablet_manager.cc:1397] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 05:03:58.573045 31682 tablet_bootstrap.cc:492] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4: Bootstrap starting.
I20260811 05:03:58.573418 31684 raft_consensus.cc:348] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.573539 31684 raft_consensus.cc:374] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:58.573570 31684 raft_consensus.cc:729] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc6961b319e47e6ac72953c546d8bc7, State: Initialized, Role: FOLLOWER
I20260811 05:03:58.573689 31684 consensus_queue.cc:260] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.573895 31682 tablet_bootstrap.cc:654] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4: Neither blocks nor log segments found. Creating new log.
I20260811 05:03:58.573966 31684 ts_tablet_manager.cc:1428] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:03:58.575402 31682 tablet_bootstrap.cc:492] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4: No bootstrap required, opened a new log
I20260811 05:03:58.575511 31682 ts_tablet_manager.cc:1397] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260811 05:03:58.576089 31682 raft_consensus.cc:348] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.576229 31682 raft_consensus.cc:374] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:58.576282 31682 raft_consensus.cc:729] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a383a30e3c34f2082fd5d1d87338ef4, State: Initialized, Role: FOLLOWER
I20260811 05:03:58.576545 31682 consensus_queue.cc:260] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.576927 31682 ts_tablet_manager.cc:1428] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 05:03:58.577898 31680 tablet_bootstrap.cc:492] T fc70939aa67d4f6983d2415b85316017 P 3b0ed08ad7124a59a445e1457ed54417: No bootstrap required, opened a new log
I20260811 05:03:58.578014 31680 ts_tablet_manager.cc:1397] T fc70939aa67d4f6983d2415b85316017 P 3b0ed08ad7124a59a445e1457ed54417: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260811 05:03:58.578506 31680 raft_consensus.cc:348] T fc70939aa67d4f6983d2415b85316017 P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.578648 31680 raft_consensus.cc:374] T fc70939aa67d4f6983d2415b85316017 P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:03:58.578689 31680 raft_consensus.cc:729] T fc70939aa67d4f6983d2415b85316017 P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b0ed08ad7124a59a445e1457ed54417, State: Initialized, Role: FOLLOWER
I20260811 05:03:58.578842 31680 consensus_queue.cc:260] T fc70939aa67d4f6983d2415b85316017 P 3b0ed08ad7124a59a445e1457ed54417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.579166 31680 ts_tablet_manager.cc:1428] T fc70939aa67d4f6983d2415b85316017 P 3b0ed08ad7124a59a445e1457ed54417: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 05:03:58.951049 31771 raft_consensus.cc:482] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:03:58.951256 31771 raft_consensus.cc:504] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.951741 31771 leader_election.cc:288] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b0ed08ad7124a59a445e1457ed54417 (127.22.49.193:46383), 7a383a30e3c34f2082fd5d1d87338ef4 (127.22.49.195:41113)
I20260811 05:03:58.952241 31280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc70939aa67d4f6983d2415b85316017" candidate_uuid: "2fc6961b319e47e6ac72953c546d8bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b0ed08ad7124a59a445e1457ed54417" is_pre_election: true
I20260811 05:03:58.952307 31597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc70939aa67d4f6983d2415b85316017" candidate_uuid: "2fc6961b319e47e6ac72953c546d8bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" is_pre_election: true
I20260811 05:03:58.952385 31280 raft_consensus.cc:2454] T fc70939aa67d4f6983d2415b85316017 P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc6961b319e47e6ac72953c546d8bc7 in term 0.
I20260811 05:03:58.952538 31597 raft_consensus.cc:2454] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc6961b319e47e6ac72953c546d8bc7 in term 0.
I20260811 05:03:58.952785 31366 leader_election.cc:302] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc6961b319e47e6ac72953c546d8bc7, 3b0ed08ad7124a59a445e1457ed54417; no voters:
I20260811 05:03:58.952982 31771 raft_consensus.cc:2781] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:03:58.953047 31771 raft_consensus.cc:482] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:03:58.953089 31771 raft_consensus.cc:3037] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:58.954137 31771 raft_consensus.cc:504] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.954609 31771 leader_election.cc:288] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [CANDIDATE]: Term 1 election: Requested vote from peers 3b0ed08ad7124a59a445e1457ed54417 (127.22.49.193:46383), 7a383a30e3c34f2082fd5d1d87338ef4 (127.22.49.195:41113)
I20260811 05:03:58.955001 31280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc70939aa67d4f6983d2415b85316017" candidate_uuid: "2fc6961b319e47e6ac72953c546d8bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b0ed08ad7124a59a445e1457ed54417"
I20260811 05:03:58.955152 31280 raft_consensus.cc:3037] T fc70939aa67d4f6983d2415b85316017 P 3b0ed08ad7124a59a445e1457ed54417 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:58.955113 31597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc70939aa67d4f6983d2415b85316017" candidate_uuid: "2fc6961b319e47e6ac72953c546d8bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a383a30e3c34f2082fd5d1d87338ef4"
I20260811 05:03:58.955255 31597 raft_consensus.cc:3037] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:03:58.956202 31280 raft_consensus.cc:2454] T fc70939aa67d4f6983d2415b85316017 P 3b0ed08ad7124a59a445e1457ed54417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc6961b319e47e6ac72953c546d8bc7 in term 1.
I20260811 05:03:58.956274 31597 raft_consensus.cc:2454] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc6961b319e47e6ac72953c546d8bc7 in term 1.
I20260811 05:03:58.956565 31366 leader_election.cc:302] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc6961b319e47e6ac72953c546d8bc7, 3b0ed08ad7124a59a445e1457ed54417; no voters:
I20260811 05:03:58.956732 31771 raft_consensus.cc:2781] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:03:58.956825 31771 raft_consensus.cc:686] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc6961b319e47e6ac72953c546d8bc7, State: Running, Role: LEADER
I20260811 05:03:58.956967 31771 consensus_queue.cc:237] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } }
I20260811 05:03:58.958873 31107 catalog_manager.cc:5495] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc6961b319e47e6ac72953c546d8bc7 (127.22.49.194). New cstate: current_term: 1 leader_uuid: "2fc6961b319e47e6ac72953c546d8bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc6961b319e47e6ac72953c546d8bc7" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 43743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 } health_report { overall_health: UNKNOWN } } }
I20260811 05:03:59.042074 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:59.039077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:35435 (local address 127.22.49.193:46383)
0811 05:03:59.039285 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:59.039289 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:59.039305 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:03:59.039447 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:59.039449 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:59.039496 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:59.039569 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:59.039762 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:59.040287 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:59.041133 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:59.041355 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:59.041430 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:59.041668 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:59.041739 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:59.041792 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:59.041900 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 05:03:59.041947 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":75,"threads_started":1}
I20260811 05:03:59.042099 31782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:59.038943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:46383 (local address 127.22.49.194:35435)
0811 05:03:59.039252 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:59.039266 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:59.039349 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:59.039589 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:59.039591 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:59.039598 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:03:59.039687 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:59.039691 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:59.040393 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:59.040395 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:59.041033 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:59.041042 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:59.041447 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:59.041450 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:59.041509 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:59.041554 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:03:59.041810 (+ 256us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:03:59.041815 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:03:59.041892 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 05:03:59.041977 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":93,"threads_started":1}
I20260811 05:03:59.048215 31597 raft_consensus.cc:1261] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Refusing update from remote peer 2fc6961b319e47e6ac72953c546d8bc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:59.048238 31280 raft_consensus.cc:1261] T fc70939aa67d4f6983d2415b85316017 P 3b0ed08ad7124a59a445e1457ed54417 [term 1 FOLLOWER]: Refusing update from remote peer 2fc6961b319e47e6ac72953c546d8bc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:03:59.048606 31771 consensus_queue.cc:1035] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a383a30e3c34f2082fd5d1d87338ef4" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:59.048761 31765 consensus_queue.cc:1035] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b0ed08ad7124a59a445e1457ed54417" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:03:59.065977 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:59.062541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:54631 (local address 127.22.49.194:43743)
0811 05:03:59.062801 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 05:03:59.062806 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:03:59.062819 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:03:59.062922 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:03:59.062925 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:03:59.063008 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:03:59.063085 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:03:59.063319 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:59.063831 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:59.064916 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:03:59.065202 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:03:59.065297 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:59.065575 (+ 278us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:03:59.065649 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:03:59.065705 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 05:03:59.065805 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 05:03:59.065857 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":73,"threads_started":1}
I20260811 05:03:59.065989 31788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:59.062432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:43743 (local address 127.22.49.193:54631)
0811 05:03:59.062708 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:59.062725 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:03:59.062825 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:03:59.063096 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:03:59.063099 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:03:59.063107 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 05:03:59.063214 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:59.063221 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:59.063949 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:59.063953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:59.064794 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:03:59.064804 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:03:59.065299 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:03:59.065303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:03:59.065396 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:03:59.065429 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 05:03:59.065738 (+ 309us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 05:03:59.065744 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 05:03:59.065798 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 05:03:59.065874 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":97,"threads_started":1}
I20260811 05:03:59.090494 31107 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:59.090675 31107 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:03:59.092918 31107 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 70ed571ca5854c279ab6545aa2524287: Sending DeleteTablet for 3 replicas of tablet fc70939aa67d4f6983d2415b85316017
I20260811 05:03:59.093600 31259 tablet_service.cc:1514] Processing DeleteTablet for tablet fc70939aa67d4f6983d2415b85316017 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:59 UTC) from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:60326
I20260811 05:03:59.093894 31578 tablet_service.cc:1514] Processing DeleteTablet for tablet fc70939aa67d4f6983d2415b85316017 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:59 UTC) from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:35696
I20260811 05:03:59.094051 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 31183
I20260811 05:03:59.094267 31421 tablet_service.cc:1514] Processing DeleteTablet for tablet fc70939aa67d4f6983d2415b85316017 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:03:59 UTC) from {username='oryx', principal='oryx/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:53880
I20260811 05:03:59.095729 31793 tablet_replica.cc:330] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4: stopping tablet replica
I20260811 05:03:59.095877 31793 raft_consensus.cc:2229] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:03:59.095997 31793 raft_consensus.cc:2258] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:59.096833 31793 ts_tablet_manager.cc:1905] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:59.097322 31794 tablet_replica.cc:330] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7: stopping tablet replica
I20260811 05:03:59.097532 31794 raft_consensus.cc:2229] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:03:59.097812 31794 raft_consensus.cc:2258] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:03:59.098668 31794 ts_tablet_manager.cc:1905] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:03:59.099740 31793 ts_tablet_manager.cc:1918] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:03:59.099828 31793 log.cc:1196] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/fc70939aa67d4f6983d2415b85316017
I20260811 05:03:59.100090 31793 ts_tablet_manager.cc:1939] T fc70939aa67d4f6983d2415b85316017 P 7a383a30e3c34f2082fd5d1d87338ef4: Deleting consensus metadata
I20260811 05:03:59.100811 31092 catalog_manager.cc:4841] TS 7a383a30e3c34f2082fd5d1d87338ef4 (127.22.49.195:41113): tablet fc70939aa67d4f6983d2415b85316017 (table test-table [id=495f197b7b1a4cd79e830837db6b1dd7]) successfully deleted
I20260811 05:03:59.102171 31794 ts_tablet_manager.cc:1918] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 05:03:59.102274 31794 log.cc:1196] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/fc70939aa67d4f6983d2415b85316017
I20260811 05:03:59.102604 31794 ts_tablet_manager.cc:1939] T fc70939aa67d4f6983d2415b85316017 P 2fc6961b319e47e6ac72953c546d8bc7: Deleting consensus metadata
I20260811 05:03:59.103471 31094 catalog_manager.cc:4841] TS 2fc6961b319e47e6ac72953c546d8bc7 (127.22.49.194:43743): tablet fc70939aa67d4f6983d2415b85316017 (table test-table [id=495f197b7b1a4cd79e830837db6b1dd7]) successfully deleted
W20260811 05:03:59.108094 31094 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:46383 (error 108)
I20260811 05:03:59.108302 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 31346
I20260811 05:03:59.112082 31796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:03:59.111274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:46383 (local address 127.0.0.1:60364)
0811 05:03:59.111835 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0811 05:03:59.111974 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:46383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":71,"threads_started":1}
W20260811 05:03:59.112301 31094 catalog_manager.cc:4584] TS 3b0ed08ad7124a59a445e1457ed54417 (127.22.49.193:46383): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fc70939aa67d4f6983d2415b85316017: Network error: Client connection negotiation failed: client connection to 127.22.49.193:46383: connect: Connection refused (error 111)
I20260811 05:03:59.117898 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 31504
I20260811 05:03:59.128497 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 31074
2026-08-11T05:03:59Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (4109 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:03:59 dist-test-slave-w206 krb5kdc[31800](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:03:59 dist-test-slave-w206 krb5kdc[31800](info): set up 2 sockets
Aug 11 05:03:59 dist-test-slave-w206 krb5kdc[31800](info): commencing operation
krb5kdc: starting...
W20260811 05:04:00.241413 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.086s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:04:00 dist-test-slave-w206 krb5kdc[31800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:04:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:04:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:04:00.383420 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:42303
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:42303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:04:00.504906 31815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:00.505267 31815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:00.505354 31815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:00.509651 31815 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:04:00.509801 31815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:00.509842 31815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:00.509984 31815 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:04:00.510074 31815 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:04:00.516144 31815 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:42303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:42303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:00.517414 31815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:00.518927 31815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:00.528693 31822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:00.528844 31815 server_base.cc:1034] running on GCE node
W20260811 05:04:00.528693 31821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:00.529150 31825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:00.529819 31815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:00.531091 31815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:00.532266 31815 hybrid_clock.cc:648] HybridClock initialized: now 1786424640532232 us; error 51 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T05:04:00Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1411 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:04:00 dist-test-slave-w206 krb5kdc[31830](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:04:00 dist-test-slave-w206 krb5kdc[31830](info): set up 2 sockets
Aug 11 05:04:00 dist-test-slave-w206 krb5kdc[31830](info): commencing operation
krb5kdc: starting...
W20260811 05:04:01.648344 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:04:01 dist-test-slave-w206 krb5kdc[31830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:04:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:04:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:04:01.795526 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:39397
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:39397
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:04:01.914069 31845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:01.914397 31845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:01.914443 31845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:01.918721 31845 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:04:01.918820 31845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:01.918840 31845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:01.918859 31845 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:04:01.918874 31845 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:04:01.924693 31845 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:39397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:39397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:01.925952 31845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:01.927158 31845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:01.936939 31850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:01.936910 31851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:01.936928 31845 server_base.cc:1034] running on GCE node
W20260811 05:04:01.936954 31853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:01.937902 31845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:01.939275 31845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:01.940476 31845 hybrid_clock.cc:648] HybridClock initialized: now 1786424641940450 us; error 49 us; skew 500 ppm
Aug 11 05:04:01 dist-test-slave-w206 krb5kdc[31830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424641, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:04:01.948367 31845 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:04:01.949580 31845 webserver.cc:460] Webserver started at http://127.22.49.254:33777/ using document root <none> and password file <none>
I20260811 05:04:01.950217 31845 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:01.950304 31845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:01.950558 31845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:01.952919 31845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "c81cd0200e7f4539851a358ceeb9e4d7"
format_stamp: "Formatted at 2026-08-11 05:04:01 on dist-test-slave-w206"
server_key: "8033500c2bc1530cd3e5eabf07d5a3ba"
server_key_iv: "8390336fa5c7ccde39489d86b51474f2"
server_key_version: "encryptionkey@0"
I20260811 05:04:01.953648 31845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "c81cd0200e7f4539851a358ceeb9e4d7"
format_stamp: "Formatted at 2026-08-11 05:04:01 on dist-test-slave-w206"
server_key: "8033500c2bc1530cd3e5eabf07d5a3ba"
server_key_iv: "8390336fa5c7ccde39489d86b51474f2"
server_key_version: "encryptionkey@0"
I20260811 05:04:01.957798 31845 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 05:04:01.960523 31862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:01.961872 31845 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 05:04:01.962026 31845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "c81cd0200e7f4539851a358ceeb9e4d7"
format_stamp: "Formatted at 2026-08-11 05:04:01 on dist-test-slave-w206"
server_key: "8033500c2bc1530cd3e5eabf07d5a3ba"
server_key_iv: "8390336fa5c7ccde39489d86b51474f2"
server_key_version: "encryptionkey@0"
I20260811 05:04:01.962157 31845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:02.017330 31845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:02.020963 31845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:02.021198 31845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:02.029162 31845 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:39397
I20260811 05:04:02.029192 31923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:39397 every 8 connection(s)
I20260811 05:04:02.030263 31845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:04:02.033347 31924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:04:02.034751 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 31845
I20260811 05:04:02.034878 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:04:02.035225 22727 external_mini_cluster.cc:1428] Setting key aa197a2601eb7926f9cfc0952dff8990
I20260811 05:04:02.041203 31924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7: Bootstrap starting.
I20260811 05:04:02.044515 31924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7: Neither blocks nor log segments found. Creating new log.
I20260811 05:04:02.045405 31924 log.cc:824] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7: Log is configured to *not* fsync() on all Append() calls
Aug 11 05:04:02 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:04:02.048113 31924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7: No bootstrap required, opened a new log
I20260811 05:04:02.052704 31927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:02.036894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35082 (local address 127.22.49.254:39397)
0811 05:04:02.037420 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:02.037442 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:02.037490 (+ 48us) server_negotiation.cc:407] Connection header received
0811 05:04:02.038397 (+ 907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:02.038430 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:02.038927 (+ 497us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:02.039395 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:02.040218 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:02.041690 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:02.042865 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:02.043686 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:02.043885 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:02.047104 (+ 3219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:02.047111 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:02.047128 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:04:02.047161 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:02.049129 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:02.049784 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:02.049791 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:02.049797 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:02.049951 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:02.050340 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:02.050343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:02.050345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:02.050865 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:02.051105 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:02.051426 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 05:04:02.051811 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":155,"threads_started":1}
I20260811 05:04:02.052762 31924 raft_consensus.cc:348] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39397 } }
I20260811 05:04:02.053145 31924 raft_consensus.cc:374] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:04:02.053241 31924 raft_consensus.cc:729] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81cd0200e7f4539851a358ceeb9e4d7, State: Initialized, Role: FOLLOWER
I20260811 05:04:02.053773 31924 consensus_queue.cc:260] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39397 } }
I20260811 05:04:02.053956 31924 raft_consensus.cc:388] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:04:02.054030 31924 raft_consensus.cc:482] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:04:02.054173 31924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:04:02.055497 31924 raft_consensus.cc:504] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39397 } }
I20260811 05:04:02.055891 31924 leader_election.cc:302] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c81cd0200e7f4539851a358ceeb9e4d7; no voters:
I20260811 05:04:02.056201 31924 leader_election.cc:288] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:04:02.056382 31929 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:04:02.056690 31929 raft_consensus.cc:686] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 1 LEADER]: Becoming Leader. State: Replica: c81cd0200e7f4539851a358ceeb9e4d7, State: Running, Role: LEADER
I20260811 05:04:02.057143 31929 consensus_queue.cc:237] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39397 } }
I20260811 05:04:02.057703 31924 sys_catalog.cc:564] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:04:02.059070 31930 sys_catalog.cc:455] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39397 } } }
I20260811 05:04:02.059116 31931 sys_catalog.cc:455] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c81cd0200e7f4539851a358ceeb9e4d7. Latest consensus state: current_term: 1 leader_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39397 } } }
I20260811 05:04:02.059222 31931 sys_catalog.cc:458] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [sys.catalog]: This master's current role is: LEADER
I20260811 05:04:02.059231 31930 sys_catalog.cc:458] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [sys.catalog]: This master's current role is: LEADER
I20260811 05:04:02.059765 31938 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:04:02.062781 31938 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:04:02.069617 31938 catalog_manager.cc:1347] Generated new cluster ID: f452b9bbc6864512bfd24bd33b5c1320
I20260811 05:04:02.069723 31938 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:04:02.081391 31938 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:04:02.082543 31938 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:04:02.087613 31938 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7: Generated new TSK 0
I20260811 05:04:02.088449 31938 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:04:02.131975 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:39397
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:04:02.263181 31950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:02.263536 31950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:02.263626 31950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:02.268059 31950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:02.268167 31950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:02.268265 31950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:04:02.273981 31950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:39397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:02.275200 31950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:02.276283 31950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:02.286875 31958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:02.286924 31956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:02.286919 31950 server_base.cc:1034] running on GCE node
W20260811 05:04:02.287061 31955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:02.287624 31950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:02.288436 31950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:02.289656 31950 hybrid_clock.cc:648] HybridClock initialized: now 1786424642289620 us; error 53 us; skew 500 ppm
Aug 11 05:04:02 dist-test-slave-w206 krb5kdc[31830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424642, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:04:02.292826 31950 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:04:02.293888 31950 webserver.cc:460] Webserver started at http://127.22.49.193:33333/ using document root <none> and password file <none>
I20260811 05:04:02.294507 31950 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:02.294607 31950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:02.294863 31950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:02.297261 31950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "e23dee0b5b3849c9ae79d782a46b64a6"
format_stamp: "Formatted at 2026-08-11 05:04:02 on dist-test-slave-w206"
server_key: "4b5dacef91faf46a06faa799bebd836c"
server_key_iv: "0e6e435a1c943e494fdadf64414e917d"
server_key_version: "encryptionkey@0"
I20260811 05:04:02.297883 31950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "e23dee0b5b3849c9ae79d782a46b64a6"
format_stamp: "Formatted at 2026-08-11 05:04:02 on dist-test-slave-w206"
server_key: "4b5dacef91faf46a06faa799bebd836c"
server_key_iv: "0e6e435a1c943e494fdadf64414e917d"
server_key_version: "encryptionkey@0"
I20260811 05:04:02.302135 31950 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 05:04:02.304986 31969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:02.306285 31950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:04:02.306443 31950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "e23dee0b5b3849c9ae79d782a46b64a6"
format_stamp: "Formatted at 2026-08-11 05:04:02 on dist-test-slave-w206"
server_key: "4b5dacef91faf46a06faa799bebd836c"
server_key_iv: "0e6e435a1c943e494fdadf64414e917d"
server_key_version: "encryptionkey@0"
I20260811 05:04:02.306581 31950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:02.331321 31950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:02.334803 31950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:02.335083 31950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:02.335759 31950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:04:02.336655 31950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:04:02.336727 31950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:02.336810 31950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:04:02.336856 31950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:02.346788 31950 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:33647
I20260811 05:04:02.346815 32096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:33647 every 8 connection(s)
I20260811 05:04:02.347887 31950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:04:02.351269 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 31950
I20260811 05:04:02.351411 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:04:02.351749 22727 external_mini_cluster.cc:1428] Setting key 617786c5bbd0de402cd08db39497a946
Aug 11 05:04:02 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424642, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:04:02.366401 31927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:02.350111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:56799 (local address 127.22.49.254:39397)
0811 05:04:02.350276 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:02.350280 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:02.351182 (+ 902us) server_negotiation.cc:407] Connection header received
0811 05:04:02.352918 (+ 1736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:02.352921 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:02.352968 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:02.353052 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:02.354529 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:02.355455 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:02.357625 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:02.357892 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:02.357993 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:02.361770 (+ 3777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:02.361775 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:02.361779 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:04:02.361820 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:02.363897 (+ 2077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:02.364628 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:02.364636 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:02.364638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:02.364739 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:02.365131 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:02.365135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:02.365136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:02.365365 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:02.365484 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:02.366066 (+ 582us) server_negotiation.cc:299] Negotiation successful
0811 05:04:02.366219 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 05:04:02.367502 32099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:02.350475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:56799)
0811 05:04:02.351018 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:02.351080 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:02.352610 (+ 1530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:02.353303 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:02.353314 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:02.353777 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:02.354309 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:02.354324 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:02.355663 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:02.355669 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:02.357445 (+ 1776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:02.357465 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:02.358090 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:02.358097 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:02.358420 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:02.359332 (+ 912us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:02.359363 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:02.361519 (+ 2156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:04:02.364080 (+ 2561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:04:02.364086 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:04:02.364103 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:04:02.364476 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:04:02.364847 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:04:02.364850 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:04:02.364852 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:04:02.365014 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:04:02.365483 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:04:02.365490 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:04:02.365807 (+ 317us) client_negotiation.cc:769] Sending connection context
0811 05:04:02.366019 (+ 212us) client_negotiation.cc:240] Negotiation successful
0811 05:04:02.366454 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":125,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
I20260811 05:04:02.368973 32097 heartbeater.cc:347] Connected to a master server at 127.22.49.254:39397
I20260811 05:04:02.369246 32097 heartbeater.cc:464] Registering TS with master...
I20260811 05:04:02.369782 32097 heartbeater.cc:511] Master 127.22.49.254:39397 requested a full tablet report, sending...
I20260811 05:04:02.371474 31881 ts_manager.cc:194] Registered new tserver with Master: e23dee0b5b3849c9ae79d782a46b64a6 (127.22.49.193:33647)
I20260811 05:04:02.373198 31881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:56799
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:04:02.387315 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:39397
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:04:02.510551 32102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:02.510919 32102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:02.511065 32102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:02.515508 32102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:02.515591 32102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:02.515702 32102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:04:02.521615 32102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:39397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:02.522914 32102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:02.524104 32102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:02.534770 32112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:02.534785 32110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:02.534885 32102 server_base.cc:1034] running on GCE node
W20260811 05:04:02.534827 32109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:02.535537 32102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:02.536339 32102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:02.537539 32102 hybrid_clock.cc:648] HybridClock initialized: now 1786424642537518 us; error 39 us; skew 500 ppm
Aug 11 05:04:02 dist-test-slave-w206 krb5kdc[31830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424642, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:04:02.540948 32102 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:04:02.542021 32102 webserver.cc:460] Webserver started at http://127.22.49.194:40241/ using document root <none> and password file <none>
I20260811 05:04:02.542614 32102 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:02.542683 32102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:02.543058 32102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:02.545372 32102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "6b456fabf652497e92acfb33727856f2"
format_stamp: "Formatted at 2026-08-11 05:04:02 on dist-test-slave-w206"
server_key: "804b77e2fe8e8dfea863b7a59211f342"
server_key_iv: "a2d5634e5d7cb8f5cfa84b2f4c5b8718"
server_key_version: "encryptionkey@0"
I20260811 05:04:02.545992 32102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "6b456fabf652497e92acfb33727856f2"
format_stamp: "Formatted at 2026-08-11 05:04:02 on dist-test-slave-w206"
server_key: "804b77e2fe8e8dfea863b7a59211f342"
server_key_iv: "a2d5634e5d7cb8f5cfa84b2f4c5b8718"
server_key_version: "encryptionkey@0"
I20260811 05:04:02.550285 32102 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260811 05:04:02.553404 32120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:02.554852 32102 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:04:02.555063 32102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "6b456fabf652497e92acfb33727856f2"
format_stamp: "Formatted at 2026-08-11 05:04:02 on dist-test-slave-w206"
server_key: "804b77e2fe8e8dfea863b7a59211f342"
server_key_iv: "a2d5634e5d7cb8f5cfa84b2f4c5b8718"
server_key_version: "encryptionkey@0"
I20260811 05:04:02.555205 32102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:02.571130 32102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:02.575470 32102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:02.575735 32102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:02.576478 32102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:04:02.577498 32102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:04:02.577577 32102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:02.577665 32102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:04:02.577715 32102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:02.589376 32102 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:42425
I20260811 05:04:02.589490 32249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:42425 every 8 connection(s)
I20260811 05:04:02.590636 32102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:04:02.596202 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 32102
I20260811 05:04:02.596354 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:04:02.596680 22727 external_mini_cluster.cc:1428] Setting key aa615dc8d4a4a7d482499d8fb83bd968
Aug 11 05:04:02 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424642, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
I20260811 05:04:02.607247 31927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:02.592756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:48129 (local address 127.22.49.254:39397)
0811 05:04:02.592897 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:02.592900 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:02.593826 (+ 926us) server_negotiation.cc:407] Connection header received
0811 05:04:02.595241 (+ 1415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:02.595245 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:02.595307 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:02.595414 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:02.597191 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:02.597894 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:02.599411 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:02.599670 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:02.599793 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:02.602829 (+ 3036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:02.602834 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:02.602836 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:04:02.602867 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:02.604580 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:02.605260 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:02.605264 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:02.605270 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:02.605361 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:02.605769 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:02.605773 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:02.605775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:02.606007 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:02.606127 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:02.606888 (+ 761us) server_negotiation.cc:299] Negotiation successful
0811 05:04:02.607072 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 05:04:02.608297 32252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:02.593133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:48129)
0811 05:04:02.593670 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:02.593715 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:02.594966 (+ 1251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:02.595604 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:02.595612 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:02.596170 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:02.596922 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:02.596957 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:02.598080 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:02.598083 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:02.599260 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:02.599272 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:02.599862 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:02.599867 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:02.600094 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:02.600826 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:02.600855 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:02.602600 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:04:02.604741 (+ 2141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:04:02.604748 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:04:02.604770 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:04:02.605113 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:04:02.605465 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:04:02.605472 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:04:02.605476 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:04:02.605657 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:04:02.606126 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:04:02.606136 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:04:02.606450 (+ 314us) client_negotiation.cc:769] Sending connection context
0811 05:04:02.606821 (+ 371us) client_negotiation.cc:240] Negotiation successful
0811 05:04:02.607262 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":139,"threads_started":1}
I20260811 05:04:02.609701 32250 heartbeater.cc:347] Connected to a master server at 127.22.49.254:39397
I20260811 05:04:02.610005 32250 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
I20260811 05:04:02.610692 32250 heartbeater.cc:511] Master 127.22.49.254:39397 requested a full tablet report, sending...
I20260811 05:04:02.612066 31881 ts_manager.cc:194] Registered new tserver with Master: 6b456fabf652497e92acfb33727856f2 (127.22.49.194:42425)
I20260811 05:04:02.612758 31881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:48129
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:04:02.631567 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:39397
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:04:02.759258 32256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:02.759598 32256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:02.759701 32256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:02.764314 32256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:02.764433 32256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:02.764505 32256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:04:02.771124 32256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:39397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:02.772349 32256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:02.773463 32256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:02.784061 32262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:02.784108 32263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:02.784065 32265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:02.784444 32256 server_base.cc:1034] running on GCE node
I20260811 05:04:02.785059 32256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:02.785863 32256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:02.787092 32256 hybrid_clock.cc:648] HybridClock initialized: now 1786424642787073 us; error 34 us; skew 500 ppm
Aug 11 05:04:02 dist-test-slave-w206 krb5kdc[31830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424642, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:04:02.790822 32256 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:04:02.792009 32256 webserver.cc:460] Webserver started at http://127.22.49.195:34143/ using document root <none> and password file <none>
I20260811 05:04:02.792699 32256 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:02.792814 32256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:02.793078 32256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:02.795675 32256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "4278f7654c11465285886ad1cd5817a9"
format_stamp: "Formatted at 2026-08-11 05:04:02 on dist-test-slave-w206"
server_key: "f49582f2d3605ff3aa108b5fd06a00b9"
server_key_iv: "8f233d0ddab89fb4b0f9439bf844c2d5"
server_key_version: "encryptionkey@0"
I20260811 05:04:02.796502 32256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "4278f7654c11465285886ad1cd5817a9"
format_stamp: "Formatted at 2026-08-11 05:04:02 on dist-test-slave-w206"
server_key: "f49582f2d3605ff3aa108b5fd06a00b9"
server_key_iv: "8f233d0ddab89fb4b0f9439bf844c2d5"
server_key_version: "encryptionkey@0"
I20260811 05:04:02.801263 32256 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:04:02.804725 32273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:02.806150 32256 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 05:04:02.806326 32256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "4278f7654c11465285886ad1cd5817a9"
format_stamp: "Formatted at 2026-08-11 05:04:02 on dist-test-slave-w206"
server_key: "f49582f2d3605ff3aa108b5fd06a00b9"
server_key_iv: "8f233d0ddab89fb4b0f9439bf844c2d5"
server_key_version: "encryptionkey@0"
I20260811 05:04:02.806517 32256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:02.824934 32256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:02.828670 32256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:02.828904 32256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:02.829550 32256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:04:02.830518 32256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:04:02.830587 32256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:02.830662 32256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:04:02.830708 32256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:02.840818 32256 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:36633
I20260811 05:04:02.840852 32400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:36633 every 8 connection(s)
I20260811 05:04:02.841823 32256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:04:02.850843 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 32256
I20260811 05:04:02.851064 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:04:02.851387 22727 external_mini_cluster.cc:1428] Setting key debfa8d8f94a75d9803aa175fa402a93
Aug 11 05:04:02 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424642, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:04:02.858042 31927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:02.844334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:41823 (local address 127.22.49.254:39397)
0811 05:04:02.844501 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:02.844507 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:02.845989 (+ 1482us) server_negotiation.cc:407] Connection header received
0811 05:04:02.846947 (+ 958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:02.846951 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:02.847031 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:02.847115 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:02.848526 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:02.849195 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:02.850525 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:02.850874 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:02.851069 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:02.854001 (+ 2932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:02.854004 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:02.854006 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:04:02.854033 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:02.855640 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:02.856276 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:02.856279 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:02.856280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:02.856372 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:02.856767 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:02.856769 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:02.856771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:02.856973 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:02.857056 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:02.857783 (+ 727us) server_negotiation.cc:299] Negotiation successful
0811 05:04:02.857910 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 05:04:02.859153 32404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:02.844893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:41823)
0811 05:04:02.845791 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:02.845850 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:02.846719 (+ 869us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:02.847313 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:02.847322 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:02.847778 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:02.848333 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:02.848349 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:02.849341 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:02.849345 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:02.850333 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:02.850345 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:02.851115 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:02.851122 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:02.851315 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:02.852039 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:02.852057 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:02.853814 (+ 1757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:04:02.855820 (+ 2006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:04:02.855826 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:04:02.855843 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:04:02.856156 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:04:02.856509 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:04:02.856511 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:04:02.856512 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:04:02.856681 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:04:02.857102 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:04:02.857108 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:04:02.857443 (+ 335us) client_negotiation.cc:769] Sending connection context
0811 05:04:02.857679 (+ 236us) client_negotiation.cc:240] Negotiation successful
0811 05:04:02.858016 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":145,"threads_started":1}
I20260811 05:04:02.860745 32402 heartbeater.cc:347] Connected to a master server at 127.22.49.254:39397
I20260811 05:04:02.861037 32402 heartbeater.cc:464] Registering TS with master...
I20260811 05:04:02.861677 32402 heartbeater.cc:511] Master 127.22.49.254:39397 requested a full tablet report, sending...
I20260811 05:04:02.862908 31881 ts_manager.cc:194] Registered new tserver with Master: 4278f7654c11465285886ad1cd5817a9 (127.22.49.195:36633)
I20260811 05:04:02.863590 31881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:41823
I20260811 05:04:02.865655 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.193.keytab.
Entry for principal oryx/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.193.keytab.
WARNING: no policy specified for oryx/127.22.49.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.49.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.194.keytab.
Entry for principal oryx/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.194.keytab.
WARNING: no policy specified for oryx/127.22.49.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.49.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.195.keytab.
Entry for principal oryx/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.195.keytab.
I20260811 05:04:02.962138 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 31950
I20260811 05:04:02.972200 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 32102
I20260811 05:04:02.981668 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 32256
I20260811 05:04:02.989944 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 31845
I20260811 05:04:02.999682 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:39397
--webserver_interface=127.22.49.254
--webserver_port=33777
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:39397
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:04:03.121444 32411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:03.121779 32411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:03.121824 32411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:03.126255 32411 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:04:03.126368 32411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:03.126389 32411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:03.126406 32411 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:04:03.126422 32411 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:04:03.132503 32411 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:39397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:39397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=33777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:03.133774 32411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:03.134891 32411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:03.144591 32417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:03.144683 32411 server_base.cc:1034] running on GCE node
W20260811 05:04:03.144582 32416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:03.144701 32419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:03.145557 32411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:03.147166 32411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:03.148379 32411 hybrid_clock.cc:648] HybridClock initialized: now 1786424643148360 us; error 46 us; skew 500 ppm
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424643, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:04:03.152081 32411 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:04:03.153132 32411 webserver.cc:460] Webserver started at http://127.22.49.254:33777/ using document root <none> and password file <none>
I20260811 05:04:03.153728 32411 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:03.153811 32411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:03.158548 32411 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:04:03.161945 32426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:03.163919 32411 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 05:04:03.164108 32411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "c81cd0200e7f4539851a358ceeb9e4d7"
format_stamp: "Formatted at 2026-08-11 05:04:01 on dist-test-slave-w206"
server_key: "8033500c2bc1530cd3e5eabf07d5a3ba"
server_key_iv: "8390336fa5c7ccde39489d86b51474f2"
server_key_version: "encryptionkey@0"
I20260811 05:04:03.164785 32411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:03.177459 32411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:03.181425 32411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:03.181614 32411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:03.190986 32411 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:39397
I20260811 05:04:03.191223 32485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:39397 every 8 connection(s)
I20260811 05:04:03.192307 32411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:04:03.197821 32487 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:04:03.198282 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 32411
I20260811 05:04:03.198838 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:33647
--local_ip_for_outbound_sockets=127.22.49.193
--tserver_master_addrs=127.22.49.254:39397
--webserver_port=33333
--webserver_interface=127.22.49.193
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.22.49.193
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:04:03.200847 32487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7: Bootstrap starting.
I20260811 05:04:03.220427 32487 log.cc:824] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7: Log is configured to *not* fsync() on all Append() calls
I20260811 05:04:03.227797 32487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:04:03.228281 32487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7: Bootstrap complete.
I20260811 05:04:03.233031 32487 raft_consensus.cc:348] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39397 } }
I20260811 05:04:03.233582 32487 raft_consensus.cc:729] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81cd0200e7f4539851a358ceeb9e4d7, State: Initialized, Role: FOLLOWER
I20260811 05:04:03.234177 32487 consensus_queue.cc:260] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39397 } }
I20260811 05:04:03.234320 32487 raft_consensus.cc:388] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:04:03.234426 32487 raft_consensus.cc:482] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:04:03.234575 32487 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 1 FOLLOWER]: Advancing to term 2
I20260811 05:04:03.236971 32487 raft_consensus.cc:504] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39397 } }
I20260811 05:04:03.237416 32487 leader_election.cc:302] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c81cd0200e7f4539851a358ceeb9e4d7; no voters:
I20260811 05:04:03.237780 32487 leader_election.cc:288] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 05:04:03.237986 32491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 05:04:03.238312 32491 raft_consensus.cc:686] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [term 2 LEADER]: Becoming Leader. State: Replica: c81cd0200e7f4539851a358ceeb9e4d7, State: Running, Role: LEADER
I20260811 05:04:03.238746 32491 consensus_queue.cc:237] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39397 } }
I20260811 05:04:03.239193 32487 sys_catalog.cc:564] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:04:03.240381 32492 sys_catalog.cc:455] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39397 } } }
I20260811 05:04:03.240546 32492 sys_catalog.cc:458] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [sys.catalog]: This master's current role is: LEADER
I20260811 05:04:03.241271 32493 sys_catalog.cc:455] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c81cd0200e7f4539851a358ceeb9e4d7. Latest consensus state: current_term: 2 leader_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81cd0200e7f4539851a358ceeb9e4d7" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39397 } } }
I20260811 05:04:03.241456 32493 sys_catalog.cc:458] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7 [sys.catalog]: This master's current role is: LEADER
I20260811 05:04:03.241484 32500 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:04:03.245877 32500 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:04:03.246615 32500 catalog_manager.cc:1259] Loaded cluster ID: f452b9bbc6864512bfd24bd33b5c1320
I20260811 05:04:03.246726 32500 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:04:03.249249 32500 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:04:03.250164 32500 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c81cd0200e7f4539851a358ceeb9e4d7: Loaded TSK: 0
I20260811 05:04:03.251679 32500 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 05:04:03.342331 32489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:03.342648 32489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:03.342697 32489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:03.347666 32489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:03.347759 32489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:03.347870 32489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:04:03.353950 32489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.193.keytab
--principal=oryx/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:33647
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=33333
--tserver_master_addrs=127.22.49.254:39397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:03.355283 32489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:03.356427 32489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:03.367908 32516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:03.367908 32515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:03.368304 32518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:03.368664 32489 server_base.cc:1034] running on GCE node
I20260811 05:04:03.369248 32489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:03.370137 32489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:03.371348 32489 hybrid_clock.cc:648] HybridClock initialized: now 1786424643371311 us; error 54 us; skew 500 ppm
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424643, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:04:03.374881 32489 init.cc:377] Logged in from keytab as oryx/127.22.49.193@KRBTEST.COM (short username oryx)
I20260811 05:04:03.376049 32489 webserver.cc:460] Webserver started at http://127.22.49.193:33333/ using document root <none> and password file <none>
I20260811 05:04:03.376684 32489 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:03.376812 32489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:03.381390 32489 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:04:03.384120 32527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:03.385596 32489 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:04:03.385774 32489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "e23dee0b5b3849c9ae79d782a46b64a6"
format_stamp: "Formatted at 2026-08-11 05:04:02 on dist-test-slave-w206"
server_key: "4b5dacef91faf46a06faa799bebd836c"
server_key_iv: "0e6e435a1c943e494fdadf64414e917d"
server_key_version: "encryptionkey@0"
I20260811 05:04:03.386420 32489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:03.416149 32489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:03.420212 32489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:03.420456 32489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:03.421129 32489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:04:03.422063 32489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:04:03.422139 32489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:03.422212 32489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:04:03.422256 32489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:03.432483 32489 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:33647
I20260811 05:04:03.432518 32653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:33647 every 8 connection(s)
I20260811 05:04:03.433636 32489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:04:03.439216 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 32489
I20260811 05:04:03.439759 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:42425
--local_ip_for_outbound_sockets=127.22.49.194
--tserver_master_addrs=127.22.49.254:39397
--webserver_port=40241
--webserver_interface=127.22.49.194
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.22.49.194
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 05:04:03.450407 32656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:03.435984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:53115 (local address 127.22.49.254:39397)
0811 05:04:03.436572 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:03.436595 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:03.436813 (+ 218us) server_negotiation.cc:407] Connection header received
0811 05:04:03.438455 (+ 1642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:03.438466 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:03.438823 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:03.439264 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:03.440847 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.442371 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.444100 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.444958 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.445194 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.449596 (+ 4402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:53115: BlockingRecv error: recv got EOF from 127.22.49.193:53115 (error 108)
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":169,"threads_started":1}
I20260811 05:04:03.450500 32658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:03.436089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:53115)
0811 05:04:03.436627 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:03.436689 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:03.437979 (+ 1290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:03.439425 (+ 1446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:03.439437 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:03.439958 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:03.440626 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.440645 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.442568 (+ 1923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.442574 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.443916 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.443930 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.445150 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.445153 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.445350 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.446092 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:03.446111 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:03.449339 (+ 3228us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":138,"threads_started":1}
W20260811 05:04:03.451305 32654 heartbeater.cc:644] Failed to heartbeat to 127.22.49.254:39397 (0 consecutive failures): Not authorized: Failed to ping master at 127.22.49.254:39397: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:03.458444 32658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:03.451851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:49081)
0811 05:04:03.452116 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:03.452129 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:03.452211 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:03.452577 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:03.452579 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:03.452748 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:03.452864 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.452870 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.454091 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.454094 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.454706 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.454716 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.455378 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.455382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.455469 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.456094 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:03.456107 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:03.458283 (+ 2176us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180}
W20260811 05:04:03.459018 32656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:03.452007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:49081 (local address 127.22.49.254:39397)
0811 05:04:03.452170 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:03.452178 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:03.452200 (+ 22us) server_negotiation.cc:407] Connection header received
0811 05:04:03.452297 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:03.452302 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:03.452372 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:03.452487 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:03.453005 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.453940 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.454833 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.455234 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.455344 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.458596 (+ 3252us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:49081: BlockingRecv error: recv got EOF from 127.22.49.193:49081 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:03.465332 32658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:03.459194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:38325)
0811 05:04:03.459339 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:03.459356 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:03.459446 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:03.459845 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:03.459849 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:03.460073 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:03.460202 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.460210 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.460996 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.461000 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.461896 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.461906 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.462356 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.462360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.462449 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.462966 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:03.463008 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:03.465180 (+ 2172us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 05:04:03.465538 32656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:03.459484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:38325 (local address 127.22.49.254:39397)
0811 05:04:03.459610 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:03.459613 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:03.459626 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:04:03.459667 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:03.459669 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:03.459709 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:03.459778 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:03.460363 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.460888 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.462018 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.462232 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.462315 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.465416 (+ 3101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:38325: BlockingRecv error: recv got EOF from 127.22.49.193:38325 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 05:04:03.465598 32654 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 05:04:03.566365 32659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:03.566674 32659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:03.566721 32659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:03.571341 32659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:03.571421 32659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:03.571487 32659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:04:03.577288 32659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.194.keytab
--principal=oryx/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:42425
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=40241
--tserver_master_addrs=127.22.49.254:39397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:03.578578 32659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:03.579739 32659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:03.590490 32667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:03.590520 32665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:03.590490 32664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:03.590771 32659 server_base.cc:1034] running on GCE node
I20260811 05:04:03.591522 32659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:03.592314 32659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:03.593506 32659 hybrid_clock.cc:648] HybridClock initialized: now 1786424643593485 us; error 41 us; skew 500 ppm
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424643, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:04:03.596657 32659 init.cc:377] Logged in from keytab as oryx/127.22.49.194@KRBTEST.COM (short username oryx)
I20260811 05:04:03.597654 32659 webserver.cc:460] Webserver started at http://127.22.49.194:40241/ using document root <none> and password file <none>
I20260811 05:04:03.598418 32659 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:03.598543 32659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:03.602957 32659 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:04:03.605335 32677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:03.606748 32659 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 05:04:03.606930 32659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "6b456fabf652497e92acfb33727856f2"
format_stamp: "Formatted at 2026-08-11 05:04:02 on dist-test-slave-w206"
server_key: "804b77e2fe8e8dfea863b7a59211f342"
server_key_iv: "a2d5634e5d7cb8f5cfa84b2f4c5b8718"
server_key_version: "encryptionkey@0"
I20260811 05:04:03.607609 32659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:03.634264 32659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:03.638212 32659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:03.638464 32659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:03.639282 32659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:04:03.640350 32659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:04:03.640426 32659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:03.640497 32659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:04:03.640542 32659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:03.650244 32659 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:42425
I20260811 05:04:03.650272 340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:42425 every 8 connection(s)
I20260811 05:04:03.651473 32659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:04:03.660066 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 32659
I20260811 05:04:03.660588 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:36633
--local_ip_for_outbound_sockets=127.22.49.195
--tserver_master_addrs=127.22.49.254:39397
--webserver_port=34143
--webserver_interface=127.22.49.195
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.22.49.195
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 05:04:03.664911 32656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:03.653641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:59317 (local address 127.22.49.254:39397)
0811 05:04:03.653803 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:03.653808 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:03.654756 (+ 948us) server_negotiation.cc:407] Connection header received
0811 05:04:03.656254 (+ 1498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:03.656257 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:03.656323 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:03.656409 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:03.657770 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.658342 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.659885 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.660175 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.660316 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.664689 (+ 4373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:59317: BlockingRecv error: recv got EOF from 127.22.49.194:59317 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 05:04:03.665445 345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:03.654089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:59317)
0811 05:04:03.654588 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:03.654636 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:03.655990 (+ 1354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:03.656621 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:03.656629 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:03.657051 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:03.657592 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.657607 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.658506 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.658509 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.659669 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.659710 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.660379 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.660383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.660589 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.661344 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:03.661363 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:03.664440 (+ 3077us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":114,"threads_started":1}
W20260811 05:04:03.666155 342 heartbeater.cc:644] Failed to heartbeat to 127.22.49.254:39397 (0 consecutive failures): Not authorized: Failed to ping master at 127.22.49.254:39397: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:03.673592 345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:03.666711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:42729)
0811 05:04:03.666823 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:03.666839 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:03.666938 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:03.667271 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:03.667277 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:03.667503 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:03.667675 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.667686 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.668499 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.668505 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.669608 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.669625 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.670127 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.670133 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.670261 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.670814 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:03.670836 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:03.673381 (+ 2545us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 05:04:03.673663 32656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:03.666838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:42729 (local address 127.22.49.254:39397)
0811 05:04:03.666966 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:03.667001 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:03.667019 (+ 18us) server_negotiation.cc:407] Connection header received
0811 05:04:03.667074 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:03.667077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:03.667126 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:03.667227 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:03.667830 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.668374 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.669749 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.669995 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.670143 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.673559 (+ 3416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:42729: BlockingRecv error: recv got EOF from 127.22.49.194:42729 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:03.680557 345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:03.674360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:39381)
0811 05:04:03.674522 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:03.674542 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:03.674649 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:03.674994 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:03.674998 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:03.675204 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:03.675341 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.675351 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.676124 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.676128 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.677044 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.677056 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.677626 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.677630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.677717 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.678234 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:03.678251 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:03.680404 (+ 2153us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 05:04:03.680721 32656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:03.674535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:39381 (local address 127.22.49.254:39397)
0811 05:04:03.674656 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:03.674659 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:03.674674 (+ 15us) server_negotiation.cc:407] Connection header received
0811 05:04:03.674800 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:03.674802 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:03.674843 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:03.674911 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:03.675488 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.676004 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.677175 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.677509 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.677601 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.680562 (+ 2961us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:39381: BlockingRecv error: recv got EOF from 127.22.49.194:39381 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 05:04:03.680881 342 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 05:04:03.787875 346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:03.788214 346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:03.788292 346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:03.792755 346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:03.792873 346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:03.792972 346 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:04:03.799252 346 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/krb5kdc/oryx_127.22.49.195.keytab
--principal=oryx/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:36633
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=34143
--tserver_master_addrs=127.22.49.254:39397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:03.800554 346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:03.801674 346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:03.812983 356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:03.813122 346 server_base.cc:1034] running on GCE node
W20260811 05:04:03.813030 352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:03.813022 353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:03.813773 346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:03.814566 346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:03.815761 346 hybrid_clock.cc:648] HybridClock initialized: now 1786424643815707 us; error 71 us; skew 500 ppm
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424643, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:04:03.818807 346 init.cc:377] Logged in from keytab as oryx/127.22.49.195@KRBTEST.COM (short username oryx)
I20260811 05:04:03.819995 346 webserver.cc:460] Webserver started at http://127.22.49.195:34143/ using document root <none> and password file <none>
I20260811 05:04:03.820638 346 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:03.820760 346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:03.825275 346 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260811 05:04:03.827695 363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:03.829051 346 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:04:03.829221 346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "4278f7654c11465285886ad1cd5817a9"
format_stamp: "Formatted at 2026-08-11 05:04:02 on dist-test-slave-w206"
server_key: "f49582f2d3605ff3aa108b5fd06a00b9"
server_key_iv: "8f233d0ddab89fb4b0f9439bf844c2d5"
server_key_version: "encryptionkey@0"
I20260811 05:04:03.829847 346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:03.844633 346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:03.849267 346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:03.849550 346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:03.850402 346 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:04:03.851475 346 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:04:03.851558 346 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:03.851636 346 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:04:03.851681 346 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:03.862730 346 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:36633
I20260811 05:04:03.862766 487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:36633 every 8 connection(s)
I20260811 05:04:03.863970 346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:04:03.870827 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 346
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 05:04:03.878474 32656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:03.866218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:57769 (local address 127.22.49.254:39397)
0811 05:04:03.866375 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:03.866380 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:03.867448 (+ 1068us) server_negotiation.cc:407] Connection header received
0811 05:04:03.869088 (+ 1640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:03.869093 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:03.869191 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:03.869303 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:03.871067 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.871642 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.873579 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.873827 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.873953 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.878324 (+ 4371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:57769: BlockingRecv error: recv got EOF from 127.22.49.195:57769 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 05:04:03.879302 491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:03.866592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:57769)
0811 05:04:03.867265 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:03.867317 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:03.868761 (+ 1444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:03.869564 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:03.869580 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:03.870058 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:03.870784 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.870809 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.871844 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.871847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.873414 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.873427 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.874011 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.874016 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.874208 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.874960 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:03.875046 (+ 86us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:03.878187 (+ 3141us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":178,"threads_started":1}
W20260811 05:04:03.879884 488 heartbeater.cc:644] Failed to heartbeat to 127.22.49.254:39397 (0 consecutive failures): Not authorized: Failed to ping master at 127.22.49.254:39397: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
I20260811 05:04:03.881939 493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:03.872097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35092 (local address 127.22.49.254:39397)
0811 05:04:03.872460 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:03.872463 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:03.872475 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:04:03.872510 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:03.872512 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:03.872550 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:03.872658 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:03.873445 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.873976 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.875039 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.875276 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.875404 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.876879 (+ 1475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:03.876887 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:03.876905 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:04:03.876937 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:03.878892 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:03.879430 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:03.879438 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:03.879444 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:03.879610 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:03.880421 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:03.880425 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:03.880427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:03.880983 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:03.881178 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:03.881509 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 05:04:03.881788 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":223,"threads_started":1}
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:03.886395 491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:03.880485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:41829)
0811 05:04:03.880617 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:03.880633 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:03.880717 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:03.880941 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:03.880943 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:03.881088 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:03.881190 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.881195 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.881977 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.881983 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.882822 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.882834 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.883349 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.883353 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.883454 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.884017 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:03.884032 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:03.886280 (+ 2248us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 05:04:03.886898 32656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:03.880565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:41829 (local address 127.22.49.254:39397)
0811 05:04:03.880692 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:03.880696 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:03.880711 (+ 15us) server_negotiation.cc:407] Connection header received
0811 05:04:03.880782 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:03.880785 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:03.880826 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:03.880917 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:03.881311 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.881835 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.882954 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.883230 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.883345 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.886788 (+ 3443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:41829: BlockingRecv error: recv got EOF from 127.22.49.195:41829 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:03 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:03.893103 491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:03.887113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:43503)
0811 05:04:03.887270 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:03.887290 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:03.887391 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:03.887696 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:03.887699 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:03.887890 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:03.887977 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.887983 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.888821 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.888828 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.889382 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:03.889392 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.890018 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.890022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:03.890109 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.890829 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:03.890842 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:03.892902 (+ 2060us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 05:04:03.893278 32656 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:03.887158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:43503 (local address 127.22.49.254:39397)
0811 05:04:03.887345 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:03.887351 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:03.887378 (+ 27us) server_negotiation.cc:407] Connection header received
0811 05:04:03.887536 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:03.887539 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:03.887583 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:03.887677 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:03.888105 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.888672 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.889522 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:03.889761 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:03.890017 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:03.893152 (+ 3135us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:43503: BlockingRecv error: recv got EOF from 127.22.49.195:43503 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
W20260811 05:04:03.893445 488 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 05:04:04 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:04 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:04.473032 494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:04.466427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:58011)
0811 05:04:04.466879 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:04.466894 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:04.467085 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:04.467456 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:04.467460 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:04.467711 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:04.467844 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:04.467867 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:04.468891 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:04.468894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:04.469570 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:04.469581 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:04.470148 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:04.470151 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:04.470218 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:04.470835 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:04.470857 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:04.472895 (+ 2038us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":97,"threads_started":1}
W20260811 05:04:04.473330 495 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:04.466600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:58011 (local address 127.22.49.254:39397)
0811 05:04:04.466869 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:04.466874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:04.467010 (+ 136us) server_negotiation.cc:407] Connection header received
0811 05:04:04.467206 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:04.467209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:04.467262 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:04.467381 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:04.468001 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:04.468737 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:04.469723 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:04.470029 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:04.470123 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:04.473161 (+ 3038us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:58011: BlockingRecv error: recv got EOF from 127.22.49.193:58011 (error 108)
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":66,"threads_started":1}
Aug 11 05:04:04 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:04 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:04.688603 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:04.681762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:49681)
0811 05:04:04.682400 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:04.682428 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:04.682569 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:04.682834 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:04.682836 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:04.683097 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:04.683200 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:04.683206 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:04.684026 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:04.684029 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:04.684624 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:04.684633 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:04.685150 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:04.685152 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:04.685220 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:04.685894 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:04.685907 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:04.688408 (+ 2501us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":466,"threads_started":1}
W20260811 05:04:04.688738 495 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:04.681886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:49681 (local address 127.22.49.254:39397)
0811 05:04:04.682045 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:04.682048 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:04.682544 (+ 496us) server_negotiation.cc:407] Connection header received
0811 05:04:04.682664 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:04.682666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:04.682716 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:04.682795 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:04.683361 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:04.683899 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:04.684759 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:04.685018 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:04.685125 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:04.688604 (+ 3479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:49681: BlockingRecv error: recv got EOF from 127.22.49.194:49681 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 05:04:04 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:04 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:04.901131 497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:04.894227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:57821)
0811 05:04:04.894613 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:04.894635 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:04.894801 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:04.895144 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:04.895147 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:04.895402 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:04.895505 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:04.895511 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:04.896497 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:04.896504 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:04.897147 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:04.897159 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:04.897690 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:04.897694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:04.897792 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:04.898461 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:04.898473 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:04.900968 (+ 2495us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":116,"threads_started":1}
W20260811 05:04:04.901582 495 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:04.894463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:57821 (local address 127.22.49.254:39397)
0811 05:04:04.894652 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:04.894660 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:04.894736 (+ 76us) server_negotiation.cc:407] Connection header received
0811 05:04:04.894921 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:04.894925 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:04.895016 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:04.895115 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:04.895647 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:04.896336 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:04.897295 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:04.897544 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:04.897666 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:04.901369 (+ 3703us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:57821: BlockingRecv error: recv got EOF from 127.22.49.195:57821 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 11 05:04:05 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:05 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:05.481218 498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:05.474173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:47681)
0811 05:04:05.474570 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:05.474587 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:05.474736 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:05.475219 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:05.475223 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:05.475463 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:05.475572 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:05.475578 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:05.476429 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:05.476433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:05.477036 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:05.477047 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:05.477554 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:05.477557 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:05.477625 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:05.478196 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:05.478209 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:05.481044 (+ 2835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":156,"threads_started":1}
W20260811 05:04:05.481591 499 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:05.474253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:47681 (local address 127.22.49.254:39397)
0811 05:04:05.474590 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:05.474596 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:05.474674 (+ 78us) server_negotiation.cc:407] Connection header received
0811 05:04:05.474956 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:05.474961 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:05.475053 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:05.475150 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:05.475743 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:05.476293 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:05.477166 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:05.477432 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:05.477522 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:05.481435 (+ 3913us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:47681: BlockingRecv error: recv got EOF from 127.22.49.193:47681 (error 108)
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":89,"threads_started":1}
Aug 11 05:04:05 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:05 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:05.696050 500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:05.689625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:42661)
0811 05:04:05.690014 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:05.690030 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:05.690141 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:05.690484 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:05.690486 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:05.690694 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:05.690806 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:05.690812 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:05.691783 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:05.691786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:05.692372 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:05.692380 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:05.692882 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:05.692887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:05.692962 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:05.693656 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:05.693670 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:05.695912 (+ 2242us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":143,"threads_started":1}
W20260811 05:04:05.696286 499 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:05.689767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:42661 (local address 127.22.49.254:39397)
0811 05:04:05.689974 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:05.689977 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:05.690128 (+ 151us) server_negotiation.cc:407] Connection header received
0811 05:04:05.690247 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:05.690251 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:05.690313 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:05.690400 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:05.691037 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:05.691647 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:05.692504 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:05.692729 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:05.692815 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:05.696134 (+ 3319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:42661: BlockingRecv error: recv got EOF from 127.22.49.194:42661 (error 108)
Metrics: {"server-negotiator.queue_time_us":120}
Aug 11 05:04:05 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:05 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:05.909070 501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:05.902507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:47693)
0811 05:04:05.902900 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:05.902918 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:05.903080 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:05.903389 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:05.903393 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:05.903633 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:05.903733 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:05.903739 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:05.904667 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:05.904671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:05.905249 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:05.905258 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:05.905779 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:05.905783 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:05.905874 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:05.906533 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:05.906547 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:05.908934 (+ 2387us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":125,"threads_started":1}
W20260811 05:04:05.909355 499 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:05.902719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:47693 (local address 127.22.49.254:39397)
0811 05:04:05.902900 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:05.902907 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:05.903001 (+ 94us) server_negotiation.cc:407] Connection header received
0811 05:04:05.903204 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:05.903209 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:05.903267 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:05.903362 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:05.903867 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:05.904543 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:05.905393 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:05.905634 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:05.905755 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:05.909220 (+ 3465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:47693: BlockingRecv error: recv got EOF from 127.22.49.195:47693 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 11 05:04:06 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:06 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:06.490411 502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:06.482532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:38805)
0811 05:04:06.482947 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:06.482967 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:06.483200 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:06.483523 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:06.483526 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:06.483732 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:06.483869 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:06.483876 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:06.484895 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:06.484899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:06.485595 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:06.485607 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:06.486179 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:06.486182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:06.486261 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:06.487051 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:06.487066 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:06.490237 (+ 3171us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":110,"threads_started":1}
W20260811 05:04:06.490694 503 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:06.482618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:38805 (local address 127.22.49.254:39397)
0811 05:04:06.483186 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:06.483190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:06.483209 (+ 19us) server_negotiation.cc:407] Connection header received
0811 05:04:06.483298 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:06.483301 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:06.483351 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:06.483448 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:06.484041 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:06.484729 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:06.485755 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:06.486030 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:06.486146 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:06.490503 (+ 4357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:38805: BlockingRecv error: recv got EOF from 127.22.49.193:38805 (error 108)
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":155,"threads_started":1}
Aug 11 05:04:06 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:06 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:06.704233 504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:06.697160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:57899)
0811 05:04:06.697536 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:06.697585 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:06.697728 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:06.698067 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:06.698071 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:06.698329 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:06.698443 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:06.698450 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:06.699464 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:06.699469 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:06.700125 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:06.700135 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:06.700674 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:06.700678 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:06.700770 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:06.701407 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:06.701421 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:06.703985 (+ 2564us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":98,"threads_started":1}
W20260811 05:04:06.704353 503 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:06.697495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:57899 (local address 127.22.49.254:39397)
0811 05:04:06.697731 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:06.697737 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:06.697804 (+ 67us) server_negotiation.cc:407] Connection header received
0811 05:04:06.697874 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:06.697877 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:06.697928 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:06.698032 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:06.698599 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:06.699332 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:06.700275 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:06.700531 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:06.700661 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:06.704193 (+ 3532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:57899: BlockingRecv error: recv got EOF from 127.22.49.194:57899 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
Aug 11 05:04:06 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:06 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:06.916674 505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:06.910026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:47785)
0811 05:04:06.910344 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:06.910358 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:06.910473 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:06.910721 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:06.910723 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:06.910938 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:06.911081 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:06.911087 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:06.912075 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:06.912078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:06.912754 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:06.912766 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:06.913342 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:06.913346 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:06.913442 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:06.914213 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:06.914228 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:06.916499 (+ 2271us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":74,"threads_started":1}
W20260811 05:04:06.916934 503 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:06.910118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:47785 (local address 127.22.49.254:39397)
0811 05:04:06.910314 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:06.910318 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:06.910444 (+ 126us) server_negotiation.cc:407] Connection header received
0811 05:04:06.910556 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:06.910558 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:06.910605 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:06.910675 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:06.911304 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:06.911949 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:06.912910 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:06.913144 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:06.913241 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:06.916772 (+ 3531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:47785: BlockingRecv error: recv got EOF from 127.22.49.195:47785 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 11 05:04:07 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:07 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:07.504477 506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:07.491385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:38381)
0811 05:04:07.491723 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:07.491738 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:07.491840 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:07.492125 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:07.492127 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:07.492324 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:07.492454 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:07.492461 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:07.493319 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:07.493322 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:07.493942 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:07.493954 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:07.494532 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:07.494535 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:07.494606 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:07.501777 (+ 7171us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:07.501795 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:07.504335 (+ 2540us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":113,"threads_started":1}
W20260811 05:04:07.504762 507 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:07.491472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:38381 (local address 127.22.49.254:39397)
0811 05:04:07.491799 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:07.491803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:07.491821 (+ 18us) server_negotiation.cc:407] Connection header received
0811 05:04:07.491941 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:07.491943 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:07.491994 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:07.492088 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:07.492619 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:07.493180 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:07.494091 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:07.494328 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:07.494448 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:07.504572 (+ 10124us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:38381: BlockingRecv error: recv got EOF from 127.22.49.193:38381 (error 108)
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":108,"threads_started":1}
Aug 11 05:04:07 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:07 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:07.712242 508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:07.705367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:33065)
0811 05:04:07.705731 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:07.705748 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:07.705918 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:07.706213 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:07.706216 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:07.706483 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:07.706589 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:07.706596 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:07.707525 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:07.707529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:07.708250 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:07.708262 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:07.708878 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:07.708882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:07.708981 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:07.709628 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:07.709642 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:07.712100 (+ 2458us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":102,"threads_started":1}
W20260811 05:04:07.712476 507 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:07.705547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:33065 (local address 127.22.49.254:39397)
0811 05:04:07.705736 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:07.705743 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:07.705849 (+ 106us) server_negotiation.cc:407] Connection header received
0811 05:04:07.706030 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:07.706033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:07.706089 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:07.706182 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:07.706736 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:07.707378 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:07.708419 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:07.708711 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:07.708868 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:07.712319 (+ 3451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:33065: BlockingRecv error: recv got EOF from 127.22.49.194:33065 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 11 05:04:07 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:07 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:07.924291 509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:07.917767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:60683)
0811 05:04:07.918193 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:07.918219 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:07.918390 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:07.918683 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:07.918686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:07.918914 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:07.919042 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:07.919049 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:07.919861 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:07.919867 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:07.920581 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:07.920592 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:07.921151 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:07.921156 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:07.921272 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:07.922027 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:07.922040 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:07.924109 (+ 2069us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":114,"threads_started":1}
W20260811 05:04:07.924415 507 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:07.917841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:60683 (local address 127.22.49.254:39397)
0811 05:04:07.917987 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:07.917991 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:07.918320 (+ 329us) server_negotiation.cc:407] Connection header received
0811 05:04:07.918495 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:07.918499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:07.918561 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:07.918656 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:07.919164 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:07.919728 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:07.920716 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:07.920960 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:07.921142 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:07.924293 (+ 3151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:60683: BlockingRecv error: recv got EOF from 127.22.49.195:60683 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 05:04:08 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:08 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:08.513182 510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:08.505658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:38465)
0811 05:04:08.506008 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:08.506042 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:08.506183 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:08.506716 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:08.506719 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:08.506945 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:08.507099 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:08.507108 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:08.508040 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:08.508043 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:08.508629 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:08.508638 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:08.509476 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:08.509480 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:08.509578 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:08.510344 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:08.510359 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:08.513002 (+ 2643us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":85,"threads_started":1}
W20260811 05:04:08.513523 511 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:08.505841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:38465 (local address 127.22.49.254:39397)
0811 05:04:08.506149 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:08.506153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:08.506171 (+ 18us) server_negotiation.cc:407] Connection header received
0811 05:04:08.506338 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:08.506340 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:08.506387 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:08.506500 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:08.507278 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:08.507900 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:08.508999 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:08.509270 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:08.509448 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:08.513193 (+ 3745us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:38465: BlockingRecv error: recv got EOF from 127.22.49.193:38465 (error 108)
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":103,"threads_started":1}
Aug 11 05:04:08 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:08 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:08.719861 512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:08.713430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:52085)
0811 05:04:08.713795 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:08.713820 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:08.713931 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:08.714212 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:08.714215 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:08.714426 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:08.714531 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:08.714537 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:08.715612 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:08.715615 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:08.716222 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:08.716232 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:08.716801 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:08.716804 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:08.716883 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:08.717552 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:08.717565 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:08.719721 (+ 2156us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":87,"threads_started":1}
W20260811 05:04:08.720094 511 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:08.713540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:52085 (local address 127.22.49.254:39397)
0811 05:04:08.713695 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:08.713699 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:08.713902 (+ 203us) server_negotiation.cc:407] Connection header received
0811 05:04:08.713997 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:08.713999 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:08.714056 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:08.714126 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:08.714674 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:08.715440 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:08.716369 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:08.716651 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:08.716752 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:08.719915 (+ 3163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:52085: BlockingRecv error: recv got EOF from 127.22.49.194:52085 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 05:04:08 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:08 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:08.931167 513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:08.925258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:47431)
0811 05:04:08.925593 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:08.925607 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:08.925704 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:08.925978 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:08.925980 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:08.926177 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:08.926273 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:08.926278 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:08.927118 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:08.927121 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:08.927725 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:08.927734 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:08.928190 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:08.928194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:08.928273 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:08.928882 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:08.928894 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:08.930998 (+ 2104us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":161,"threads_started":1}
W20260811 05:04:08.931432 511 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:08.925411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:47431 (local address 127.22.49.254:39397)
0811 05:04:08.925571 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:08.925575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:08.925681 (+ 106us) server_negotiation.cc:407] Connection header received
0811 05:04:08.925807 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:08.925809 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:08.925854 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:08.925935 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:08.926393 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:08.926955 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:08.927832 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:08.928050 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:08.928133 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:08.931235 (+ 3102us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:47431: BlockingRecv error: recv got EOF from 127.22.49.195:47431 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 05:04:09 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:09 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:09.521329 514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:09.514462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:50727)
0811 05:04:09.514887 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:09.514902 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:09.515060 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:09.515496 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:09.515499 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:09.515768 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:09.515912 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:09.515942 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:09.516938 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:09.516941 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:09.517516 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:09.517524 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:09.518037 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:09.518040 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:09.518126 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:09.518733 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:09.518748 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:09.521162 (+ 2414us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":108,"threads_started":1}
W20260811 05:04:09.521555 515 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:09.514567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:50727 (local address 127.22.49.254:39397)
0811 05:04:09.515039 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:09.515045 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:09.515065 (+ 20us) server_negotiation.cc:407] Connection header received
0811 05:04:09.515196 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:09.515199 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:09.515256 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:09.515399 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:09.516101 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:09.516812 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:09.517645 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:09.517899 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:09.517988 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:09.521385 (+ 3397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:50727: BlockingRecv error: recv got EOF from 127.22.49.193:50727 (error 108)
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":211,"threads_started":1}
Aug 11 05:04:09 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:09 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:09.726965 516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:09.720950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:58757)
0811 05:04:09.721428 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:09.721445 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:09.721619 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:09.721924 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:09.721943 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:09.722170 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:09.722267 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:09.722274 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:09.723141 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:09.723146 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:09.723704 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:09.723712 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:09.724187 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:09.724191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:09.724277 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:09.724875 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:09.724887 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:09.726775 (+ 1888us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":102,"threads_started":1}
W20260811 05:04:09.727059 515 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:09.721126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:58757 (local address 127.22.49.254:39397)
0811 05:04:09.721411 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:09.721416 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:09.721552 (+ 136us) server_negotiation.cc:407] Connection header received
0811 05:04:09.721748 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:09.721750 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:09.721797 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:09.721900 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:09.722404 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:09.722955 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:09.723830 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:09.724063 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:09.724188 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:09.726913 (+ 2725us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:58757: BlockingRecv error: recv got EOF from 127.22.49.194:58757 (error 108)
Metrics: {"server-negotiator.queue_time_us":169}
Aug 11 05:04:09 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:09 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:09.938634 517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:09.932366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:43077)
0811 05:04:09.932657 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:09.932672 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:09.932788 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:09.933150 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:09.933156 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:09.933448 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:09.933597 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:09.933604 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:09.934434 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:09.934439 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:09.935283 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:09.935295 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:09.935758 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:09.935762 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:09.935857 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:09.936405 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:09.936417 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:09.938442 (+ 2025us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":99,"threads_started":1}
W20260811 05:04:09.938716 515 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:09.932513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:43077 (local address 127.22.49.254:39397)
0811 05:04:09.932696 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:09.932700 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:09.932737 (+ 37us) server_negotiation.cc:407] Connection header received
0811 05:04:09.932945 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:09.932948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:09.933001 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:09.933090 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:09.933760 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:09.934314 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:09.935405 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:09.935641 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:09.935753 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:09.938590 (+ 2837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:43077: BlockingRecv error: recv got EOF from 127.22.49.195:43077 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 11 05:04:10 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:10 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:10.528941 518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:10.522390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:48783)
0811 05:04:10.522789 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:10.522806 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:10.522917 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:10.523235 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:10.523239 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:10.523459 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:10.523565 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:10.523572 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:10.524446 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:10.524449 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:10.525038 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:10.525047 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:10.525611 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:10.525614 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:10.525682 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:10.526632 (+ 950us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:10.526647 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:10.528803 (+ 2156us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":89,"threads_started":1}
W20260811 05:04:10.529261 519 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:10.522494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:48783 (local address 127.22.49.254:39397)
0811 05:04:10.522771 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:10.522775 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:10.522862 (+ 87us) server_negotiation.cc:407] Connection header received
0811 05:04:10.523038 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:10.523040 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:10.523082 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:10.523164 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:10.523717 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:10.524293 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:10.525187 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:10.525479 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:10.525591 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:10.529090 (+ 3499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:48783: BlockingRecv error: recv got EOF from 127.22.49.193:48783 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":75,"threads_started":1}
Aug 11 05:04:10 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:10 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:10.734516 520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:10.727981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:46705)
0811 05:04:10.728414 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:10.728431 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:10.728578 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:10.728890 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:10.728893 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:10.729149 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:10.729293 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:10.729305 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:10.730213 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:10.730216 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:10.730795 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:10.730804 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:10.731253 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:10.731256 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:10.731317 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:10.731856 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:10.731874 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:10.734329 (+ 2455us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":100,"threads_started":1}
W20260811 05:04:10.734673 519 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:10.728135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:46705 (local address 127.22.49.254:39397)
0811 05:04:10.728295 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:10.728299 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:10.728664 (+ 365us) server_negotiation.cc:407] Connection header received
0811 05:04:10.728708 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:10.728710 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:10.728755 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:10.728820 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:10.729425 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:10.730108 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:10.730912 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:10.731153 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:10.731227 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:10.734549 (+ 3322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:46705: BlockingRecv error: recv got EOF from 127.22.49.194:46705 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 11 05:04:10 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:10 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:10.945972 521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:10.939772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:37471)
0811 05:04:10.940142 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:10.940156 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:10.940284 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:10.940581 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:10.940584 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:10.940816 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:10.940907 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:10.940915 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:10.941877 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:10.941881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:10.942451 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:10.942461 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:10.943021 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:10.943026 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:10.943101 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:10.943708 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:10.943720 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:10.945844 (+ 2124us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":137,"threads_started":1}
W20260811 05:04:10.946174 519 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:10.939822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:37471 (local address 127.22.49.254:39397)
0811 05:04:10.940004 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:10.940009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:10.940242 (+ 233us) server_negotiation.cc:407] Connection header received
0811 05:04:10.940368 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:10.940370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:10.940423 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:10.940555 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:10.941133 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:10.941750 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:10.942605 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:10.942851 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:10.942952 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:10.946016 (+ 3064us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:37471: BlockingRecv error: recv got EOF from 127.22.49.195:37471 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 05:04:11 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:11 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:11.538805 522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:11.530280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:49555)
0811 05:04:11.530655 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:11.530671 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:11.531036 (+ 365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:11.532105 (+ 1069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:11.532108 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:11.532446 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:11.532582 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:11.532590 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:11.533933 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:11.533941 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:11.534619 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:11.534638 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:11.535212 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:11.535216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:11.535308 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:11.536071 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:11.536087 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:11.538658 (+ 2571us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":158,"threads_started":1}
W20260811 05:04:11.539362 524 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:11.530574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:49555 (local address 127.22.49.254:39397)
0811 05:04:11.530906 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:11.530910 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:11.530929 (+ 19us) server_negotiation.cc:407] Connection header received
0811 05:04:11.531560 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:11.531566 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:11.531689 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:11.532127 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:11.532735 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:11.533780 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:11.534757 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:11.535071 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:11.535188 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:11.539148 (+ 3960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:49555: BlockingRecv error: recv got EOF from 127.22.49.193:49555 (error 108)
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":128,"threads_started":1}
Aug 11 05:04:11 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:11 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:11.742278 526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:11.735586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:60625)
0811 05:04:11.735881 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:11.735898 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:11.736002 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:11.736243 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:11.736245 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:11.736483 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:11.736586 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:11.736592 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:11.737551 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:11.737555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:11.738159 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:11.738170 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:11.738741 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:11.738744 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:11.738895 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:11.739727 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:11.739747 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:11.742139 (+ 2392us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":108,"threads_started":1}
W20260811 05:04:11.742718 524 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:11.735621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:60625 (local address 127.22.49.254:39397)
0811 05:04:11.735797 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:11.735801 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:11.735996 (+ 195us) server_negotiation.cc:407] Connection header received
0811 05:04:11.736089 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:11.736091 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:11.736144 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:11.736211 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:11.736708 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:11.737409 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:11.738354 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:11.738589 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:11.738681 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:11.742440 (+ 3759us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:60625: BlockingRecv error: recv got EOF from 127.22.49.194:60625 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 05:04:11 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:11 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:11.953032 527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:11.946919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:33163)
0811 05:04:11.947303 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:11.947318 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:11.947436 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:11.947745 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:11.947748 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:11.947963 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:11.948066 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:11.948071 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:11.948926 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:11.948929 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:11.949510 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:11.949519 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:11.950050 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:11.950053 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:11.950124 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:11.950726 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:11.950740 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:11.952892 (+ 2152us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":187,"threads_started":1}
W20260811 05:04:11.953243 524 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:11.947129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:33163 (local address 127.22.49.254:39397)
0811 05:04:11.947316 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:11.947319 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:11.947424 (+ 105us) server_negotiation.cc:407] Connection header received
0811 05:04:11.947515 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:11.947518 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:11.947579 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:11.947661 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:11.948206 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:11.948786 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:11.949667 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:11.949901 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:11.950013 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:11.953094 (+ 3081us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:33163: BlockingRecv error: recv got EOF from 127.22.49.195:33163 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 05:04:12 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:12 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:12.553604 528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:12.539980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:59409)
0811 05:04:12.540385 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:12.540402 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:12.540628 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:12.540968 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:12.540974 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:12.541255 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:12.541395 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:12.541403 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:12.542231 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:12.542234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:12.542857 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:12.542877 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:12.543507 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:12.543510 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:12.543582 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:12.550618 (+ 7036us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:12.550640 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:12.553366 (+ 2726us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":87,"threads_started":1}
W20260811 05:04:12.553825 529 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:12.540077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:59409 (local address 127.22.49.254:39397)
0811 05:04:12.540370 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:12.540374 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:12.540488 (+ 114us) server_negotiation.cc:407] Connection header received
0811 05:04:12.540742 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:12.540745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:12.540821 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:12.540915 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:12.541540 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:12.542102 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:12.543039 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:12.543357 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:12.543465 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:12.553651 (+ 10186us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:59409: BlockingRecv error: recv got EOF from 127.22.49.193:59409 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":87,"threads_started":1}
Aug 11 05:04:12 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:12 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:12.750195 530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:12.743367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:45891)
0811 05:04:12.743678 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:12.743692 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:12.743819 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:12.744121 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:12.744123 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:12.744357 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:12.744462 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:12.744468 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:12.745363 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:12.745366 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:12.745986 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:12.745997 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:12.746540 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:12.746543 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:12.746613 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:12.747397 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:12.747410 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:12.750053 (+ 2643us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":122,"threads_started":1}
W20260811 05:04:12.750488 529 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:12.743429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:45891 (local address 127.22.49.254:39397)
0811 05:04:12.743600 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:12.743606 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:12.743786 (+ 180us) server_negotiation.cc:407] Connection header received
0811 05:04:12.743910 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:12.743913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:12.743966 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:12.744050 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:12.744602 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:12.745194 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:12.746144 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:12.746404 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:12.746505 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:12.750358 (+ 3853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:45891: BlockingRecv error: recv got EOF from 127.22.49.194:45891 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 05:04:12 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:12 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:12.960824 531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:12.954062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:57259)
0811 05:04:12.954491 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:12.954505 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:12.954617 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:12.954917 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:12.954919 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:12.955163 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:12.955264 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:12.955270 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:12.956154 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:12.956157 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:12.956730 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:12.956740 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:12.957337 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:12.957340 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:12.957409 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:12.958140 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:12.958152 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:12.960639 (+ 2487us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":149,"threads_started":1}
W20260811 05:04:12.960922 529 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:12.954240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:57259 (local address 127.22.49.254:39397)
0811 05:04:12.954412 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:12.954416 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:12.954612 (+ 196us) server_negotiation.cc:407] Connection header received
0811 05:04:12.954714 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:12.954716 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:12.954769 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:12.954855 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:12.955436 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:12.956022 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:12.956890 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:12.957134 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:12.957226 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:12.960789 (+ 3563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:57259: BlockingRecv error: recv got EOF from 127.22.49.195:57259 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 05:04:13 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:13 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:13.561584 532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:13.554792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:50043)
0811 05:04:13.555235 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:13.555273 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:13.555413 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:13.555751 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:13.555753 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:13.555991 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:13.556132 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:13.556143 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:13.557161 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:13.557166 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:13.557844 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:13.557860 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:13.558445 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:13.558449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:13.558543 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:13.559253 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:13.559266 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:13.561386 (+ 2120us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":135,"threads_started":1}
W20260811 05:04:13.561697 533 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:13.555027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:50043 (local address 127.22.49.254:39397)
0811 05:04:13.555274 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:13.555280 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:13.555368 (+ 88us) server_negotiation.cc:407] Connection header received
0811 05:04:13.555537 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:13.555539 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:13.555586 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:13.555706 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:13.556268 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:13.557036 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:13.557973 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:13.558202 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:13.558288 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:13.561544 (+ 3256us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:50043: BlockingRecv error: recv got EOF from 127.22.49.193:50043 (error 108)
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":69,"threads_started":1}
Aug 11 05:04:13 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:13 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:13.757176 534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:13.751356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:55195)
0811 05:04:13.751651 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:13.751669 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:13.751818 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:13.752083 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:13.752086 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:13.752383 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:13.752482 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:13.752489 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:13.753322 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:13.753328 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:13.753926 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:13.753935 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:13.754420 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:13.754424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:13.754512 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:13.755081 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:13.755092 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:13.757058 (+ 1966us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":91,"threads_started":1}
W20260811 05:04:13.757431 533 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:13.751508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:55195 (local address 127.22.49.254:39397)
0811 05:04:13.751654 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:13.751659 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:13.751859 (+ 200us) server_negotiation.cc:407] Connection header received
0811 05:04:13.751911 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:13.751914 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:13.751970 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:13.752060 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:13.752610 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:13.753210 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:13.754052 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:13.754296 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:13.754403 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:13.757250 (+ 2847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:55195: BlockingRecv error: recv got EOF from 127.22.49.194:55195 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 05:04:13 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:13 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:13.967774 535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:13.961789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:48963)
0811 05:04:13.962144 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:13.962161 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:13.962272 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:13.962558 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:13.962561 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:13.962805 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:13.962903 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:13.962909 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:13.963740 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:13.963744 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:13.964316 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:13.964324 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:13.964815 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:13.964818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:13.964905 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:13.965530 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:13.965542 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:13.967584 (+ 2042us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":142,"threads_started":1}
W20260811 05:04:13.967844 533 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:13.961992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:48963 (local address 127.22.49.254:39397)
0811 05:04:13.962144 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:13.962150 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:13.962218 (+ 68us) server_negotiation.cc:407] Connection header received
0811 05:04:13.962381 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:13.962386 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:13.962443 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:13.962533 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:13.963061 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:13.963614 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:13.964439 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:13.964689 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:13.964808 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:13.967726 (+ 2918us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:48963: BlockingRecv error: recv got EOF from 127.22.49.195:48963 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 11 05:04:14 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:14 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:14.569036 536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:14.562746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:59395)
0811 05:04:14.563082 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:14.563096 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:14.563198 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:14.563498 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:14.563500 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:14.563699 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:14.563834 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:14.563840 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:14.564685 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:14.564687 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:14.565260 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:14.565269 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:14.565803 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:14.565806 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:14.565872 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:14.566453 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:14.566467 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:14.568855 (+ 2388us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":119,"threads_started":1}
W20260811 05:04:14.569188 537 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:14.562897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:59395 (local address 127.22.49.254:39397)
0811 05:04:14.563165 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:14.563169 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:14.563186 (+ 17us) server_negotiation.cc:407] Connection header received
0811 05:04:14.563310 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:14.563312 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:14.563358 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:14.563451 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:14.563997 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:14.564567 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:14.565400 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:14.565679 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:14.565778 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:14.569024 (+ 3246us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:59395: BlockingRecv error: recv got EOF from 127.22.49.193:59395 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":117,"threads_started":1}
Aug 11 05:04:14 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:14 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:14.764781 538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:14.758294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:55717)
0811 05:04:14.758639 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:14.758657 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:14.758802 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:14.759336 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:14.759338 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:14.759552 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:14.759658 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:14.759664 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:14.760548 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:14.760551 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:14.761140 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:14.761150 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:14.761700 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:14.761703 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:14.761777 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:14.762405 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:14.762418 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:14.764613 (+ 2195us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":82,"threads_started":1}
W20260811 05:04:14.765022 537 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:14.758390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:55717 (local address 127.22.49.254:39397)
0811 05:04:14.758614 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:14.758618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:14.758763 (+ 145us) server_negotiation.cc:407] Connection header received
0811 05:04:14.758965 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:14.758968 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:14.759110 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:14.759208 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:14.759799 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:14.760409 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:14.761282 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:14.761558 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:14.761650 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:14.764831 (+ 3181us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:55717: BlockingRecv error: recv got EOF from 127.22.49.194:55717 (error 108)
Metrics: {"server-negotiator.queue_time_us":119}
Aug 11 05:04:14 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:14 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:14.974936 539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:14.968986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:60555)
0811 05:04:14.969313 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:14.969329 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:14.969497 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:14.969843 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:14.969846 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:14.970059 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:14.970162 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:14.970167 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:14.971088 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:14.971091 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:14.971691 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:14.971701 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:14.972154 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:14.972156 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:14.972217 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:14.972780 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:14.972792 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:14.974770 (+ 1978us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":120,"threads_started":1}
W20260811 05:04:14.975167 537 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:14.969071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:60555 (local address 127.22.49.254:39397)
0811 05:04:14.969215 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:14.969218 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:14.969462 (+ 244us) server_negotiation.cc:407] Connection header received
0811 05:04:14.969606 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:14.969608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:14.969660 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:14.969753 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:14.970359 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:14.970905 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:14.971821 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:14.972045 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:14.972132 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:14.975029 (+ 2897us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:60555: BlockingRecv error: recv got EOF from 127.22.49.195:60555 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 05:04:15 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:15 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:15.576332 540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:15.570185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:56223)
0811 05:04:15.570520 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:15.570534 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:15.570633 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:15.570931 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:15.570933 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:15.571152 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:15.571249 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:15.571254 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:15.572057 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:15.572059 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:15.572633 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:15.572643 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:15.573144 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:15.573147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:15.573230 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:15.573818 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:15.573832 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:15.576162 (+ 2330us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":141,"threads_started":1}
W20260811 05:04:15.576498 541 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:15.570287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:56223 (local address 127.22.49.254:39397)
0811 05:04:15.570571 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:15.570575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:15.570591 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:04:15.570727 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:15.570730 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:15.570803 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:15.570895 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:15.571397 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:15.571952 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:15.572742 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:15.572997 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:15.573084 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:15.576326 (+ 3242us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:56223: BlockingRecv error: recv got EOF from 127.22.49.193:56223 (error 108)
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":92,"threads_started":1}
Aug 11 05:04:15 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:15 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:15.772576 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:15.765770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:49107)
0811 05:04:15.766145 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:15.766164 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:15.766331 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:15.766669 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:15.766672 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:15.766907 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:15.767044 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:15.767081 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:15.767910 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:15.767917 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:15.768476 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:15.768486 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:15.768998 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:15.769002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:15.769092 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:15.769942 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:15.769957 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:15.772398 (+ 2441us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":140,"threads_started":1}
W20260811 05:04:15.772787 541 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:15.765957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:49107 (local address 127.22.49.254:39397)
0811 05:04:15.766125 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:15.766130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:15.766262 (+ 132us) server_negotiation.cc:407] Connection header received
0811 05:04:15.766494 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:15.766497 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:15.766544 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:15.766639 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:15.767196 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:15.767750 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:15.768615 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:15.768857 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:15.768981 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:15.772551 (+ 3570us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:49107: BlockingRecv error: recv got EOF from 127.22.49.194:49107 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 05:04:15 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:15 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:15.982368 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:15.975880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:43517)
0811 05:04:15.976252 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:15.976274 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:15.976413 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:15.976721 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:15.976724 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:15.976958 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:15.977056 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:15.977062 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:15.977885 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:15.977895 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:15.978446 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:15.978454 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:15.978946 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:15.978949 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:15.979074 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:15.979691 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:15.979704 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:15.982227 (+ 2523us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":121,"threads_started":1}
W20260811 05:04:15.982923 541 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:15.975989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:43517 (local address 127.22.49.254:39397)
0811 05:04:15.976214 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:15.976220 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:15.976399 (+ 179us) server_negotiation.cc:407] Connection header received
0811 05:04:15.976540 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:15.976543 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:15.976601 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:15.976694 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:15.977195 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:15.977739 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:15.978578 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:15.978818 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:15.978936 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:15.982819 (+ 3883us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:43517: BlockingRecv error: recv got EOF from 127.22.49.195:43517 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
Aug 11 05:04:16 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:16 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:16.583786 544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:16.577558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:49803)
0811 05:04:16.577888 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:16.577902 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:16.578040 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:16.578304 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:16.578306 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:16.578504 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:16.578601 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:16.578606 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:16.579500 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:16.579503 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:16.580117 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:16.580126 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:16.580591 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:16.580594 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:16.580673 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:16.581317 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:16.581331 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:16.583629 (+ 2298us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":92,"threads_started":1}
W20260811 05:04:16.584201 545 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:16.577660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:49803 (local address 127.22.49.254:39397)
0811 05:04:16.577963 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:16.577968 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:16.577982 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:04:16.578133 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:16.578136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:16.578180 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:16.578256 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:16.578720 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:16.579381 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:16.580230 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:16.580475 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:16.580557 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:16.583851 (+ 3294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:49803: BlockingRecv error: recv got EOF from 127.22.49.193:49803 (error 108)
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":64,"threads_started":1}
Aug 11 05:04:16 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:16 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:16.779281 546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:16.773434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:33269)
0811 05:04:16.773863 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:16.773878 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:16.774011 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:16.774317 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:16.774320 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:16.774541 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:16.774634 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:16.774640 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:16.775501 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:16.775507 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:16.776067 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:16.776075 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:16.776547 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:16.776551 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:16.776636 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:16.777214 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:16.777226 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:16.779138 (+ 1912us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":84,"threads_started":1}
W20260811 05:04:16.779439 545 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:16.773571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:33269 (local address 127.22.49.254:39397)
0811 05:04:16.773713 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:16.773716 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:16.773965 (+ 249us) server_negotiation.cc:407] Connection header received
0811 05:04:16.774121 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:16.774124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:16.774179 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:16.774263 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:16.774758 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:16.775386 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:16.776192 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:16.776431 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:16.776544 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:16.779282 (+ 2738us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:33269: BlockingRecv error: recv got EOF from 127.22.49.194:33269 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 05:04:16 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:16 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:16.989984 547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:16.983507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:51505)
0811 05:04:16.983795 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:16.983818 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:16.983937 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:16.984305 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:16.984309 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:16.984552 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:16.984653 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:16.984659 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:16.985512 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:16.985515 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:16.986123 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:16.986133 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:16.986863 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:16.986866 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:16.986938 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:16.987663 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:16.987677 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:16.989813 (+ 2136us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":114,"threads_started":1}
W20260811 05:04:16.990149 545 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:16.983693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:51505 (local address 127.22.49.254:39397)
0811 05:04:16.983841 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:16.983845 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:16.983884 (+ 39us) server_negotiation.cc:407] Connection header received
0811 05:04:16.984069 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:16.984071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:16.984127 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:16.984222 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:16.984802 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:16.985384 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:16.986479 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:16.986718 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:16.986829 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:16.989999 (+ 3170us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:51505: BlockingRecv error: recv got EOF from 127.22.49.195:51505 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 05:04:17 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:17 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:17.595422 548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:17.584731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:53585)
0811 05:04:17.585029 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:17.585044 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:17.585140 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:17.585643 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:17.585646 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:17.585840 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:17.585944 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:17.585950 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:17.586811 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:17.586813 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:17.587528 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:17.587540 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:17.588050 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:17.588053 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:17.588133 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:17.592478 (+ 4345us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:17.592495 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:17.595264 (+ 2769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":116,"threads_started":1}
W20260811 05:04:17.595709 549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:17.584967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:53585 (local address 127.22.49.254:39397)
0811 05:04:17.585382 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:17.585386 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:17.585400 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:04:17.585441 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:17.585443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:17.585485 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:17.585576 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:17.586097 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:17.586688 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:17.587666 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:17.587925 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:17.588014 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:17.595409 (+ 7395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:53585: BlockingRecv error: recv got EOF from 127.22.49.193:53585 (error 108)
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":129,"threads_started":1}
Aug 11 05:04:17 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:17 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:17.786167 550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:17.780207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:55067)
0811 05:04:17.780519 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:17.780532 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:17.780634 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:17.780882 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:17.780884 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:17.781079 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:17.781185 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:17.781191 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:17.781955 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:17.781958 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:17.782573 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:17.782583 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:17.783118 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:17.783121 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:17.783189 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:17.783835 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:17.783848 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:17.786011 (+ 2163us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":126,"threads_started":1}
W20260811 05:04:17.786388 549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:17.780269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:55067 (local address 127.22.49.254:39397)
0811 05:04:17.780427 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:17.780430 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:17.780600 (+ 170us) server_negotiation.cc:407] Connection header received
0811 05:04:17.780712 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:17.780714 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:17.780758 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:17.780835 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:17.781289 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:17.781820 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:17.782705 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:17.782949 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:17.783117 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:17.786252 (+ 3135us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:55067: BlockingRecv error: recv got EOF from 127.22.49.194:55067 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 05:04:17 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:17 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.195@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:17.996878 551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:17.991058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.195:47125)
0811 05:04:17.991361 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:17.991381 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:17.991480 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:17.991728 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:17.991730 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:17.991930 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:17.992024 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:17.992029 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:17.992855 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:17.992858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:17.993472 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:17.993482 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:17.993958 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:17.993961 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:17.994026 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:17.994635 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:17.994647 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:17.996747 (+ 2100us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":117,"threads_started":1}
W20260811 05:04:17.997061 549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:17.991162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:47125 (local address 127.22.49.254:39397)
0811 05:04:17.991352 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:17.991356 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:17.991448 (+ 92us) server_negotiation.cc:407] Connection header received
0811 05:04:17.991558 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:17.991560 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:17.991610 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:17.991694 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:17.992154 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:17.992735 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:17.993601 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:17.993842 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:17.993933 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:17.996917 (+ 2984us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.195:47125: BlockingRecv error: recv got EOF from 127.22.49.195:47125 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
Aug 11 05:04:18 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:18 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.193@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:18.602334 552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:18.596331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.193:55549)
0811 05:04:18.596678 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:18.596692 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:18.596781 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:18.597128 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:18.597131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:18.597350 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:18.597484 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:18.597493 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:18.598352 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:18.598354 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:18.598953 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:18.598963 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:18.599432 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:18.599434 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:18.599521 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:18.600114 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:18.600126 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:18.602158 (+ 2032us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":94,"threads_started":1}
W20260811 05:04:18.602609 553 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:18.596492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:55549 (local address 127.22.49.254:39397)
0811 05:04:18.596758 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:18.596761 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:18.596784 (+ 23us) server_negotiation.cc:407] Connection header received
0811 05:04:18.596894 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:18.596896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:18.596942 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:18.597051 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:18.597630 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:18.598244 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:18.599099 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:18.599329 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:18.599415 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:18.602410 (+ 2995us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.193:55549: BlockingRecv error: recv got EOF from 127.22.49.193:55549 (error 108)
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":68,"threads_started":1}
Aug 11 05:04:18 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 05:04:18 dist-test-slave-w206 krb5kdc[31830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.49.194@KRBTEST.COM for oryx/127.22.49.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 05:04:18.794215 554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:18.787318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39397 (local address 127.22.49.194:33605)
0811 05:04:18.787820 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:18.787840 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:18.787952 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:18.788260 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:18.788263 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:18.788537 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:18.788689 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:18.788697 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:18.789874 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:18.789877 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:18.790539 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:18.790557 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:18.791227 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:18.791230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:18.791332 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:18.791884 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:18.791896 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:18.794078 (+ 2182us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.49.254:39397: Server oryx/127.22.49.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":135,"threads_started":1}
W20260811 05:04:18.794425 553 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:18.787597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:33605 (local address 127.22.49.254:39397)
0811 05:04:18.787778 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:18.787782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:18.787934 (+ 152us) server_negotiation.cc:407] Connection header received
0811 05:04:18.788040 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:18.788047 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:18.788119 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:18.788199 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:18.788882 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:18.789743 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:18.790697 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:18.791088 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:18.791183 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:18.794290 (+ 3107us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.49.194:33605: BlockingRecv error: recv got EOF from 127.22.49.194:33605 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 05:04:18.872349 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 32489
I20260811 05:04:18.881222 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 32659
I20260811 05:04:18.889106 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 346
I20260811 05:04:18.897681 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 32411
2026-08-11T05:04:18Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18357 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T05:04:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:04:18Z Disabled control of system clock
I20260811 05:04:18.935269 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:32985
--webserver_interface=127.22.49.254
--webserver_port=0
--builtin_ntp_servers=127.22.49.212:46827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:32985
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 05:04:19.056396 558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:19.056712 558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:19.056757 558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:19.060873 558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:04:19.060951 558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:19.060966 558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:19.060983 558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:04:19.060999 558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:04:19.066246 558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:46827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:32985
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:32985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:19.067448 558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:19.068840 558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:19.078469 566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:19.078469 569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:19.078552 558 server_base.cc:1034] running on GCE node
W20260811 05:04:19.078500 565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:19.079403 558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:19.080691 558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:19.081890 558 hybrid_clock.cc:648] HybridClock initialized: now 1786424659081871 us; error 33 us; skew 500 ppm
I20260811 05:04:19.084002 558 webserver.cc:460] Webserver started at http://127.22.49.254:38409/ using document root <none> and password file <none>
I20260811 05:04:19.084672 558 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:19.084777 558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:19.085032 558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:19.087376 558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "64a9307df7de4afdbdf78c224c286a4f"
format_stamp: "Formatted at 2026-08-11 05:04:19 on dist-test-slave-w206"
server_key: "23a368f5609cecf8ab3ada4363684dc9"
server_key_iv: "2370a2a39c43b5b14fb2549198015f05"
server_key_version: "encryptionkey@0"
I20260811 05:04:19.087968 558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "64a9307df7de4afdbdf78c224c286a4f"
format_stamp: "Formatted at 2026-08-11 05:04:19 on dist-test-slave-w206"
server_key: "23a368f5609cecf8ab3ada4363684dc9"
server_key_iv: "2370a2a39c43b5b14fb2549198015f05"
server_key_version: "encryptionkey@0"
I20260811 05:04:19.091941 558 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 05:04:19.094735 575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:19.096050 558 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 05:04:19.096213 558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "64a9307df7de4afdbdf78c224c286a4f"
format_stamp: "Formatted at 2026-08-11 05:04:19 on dist-test-slave-w206"
server_key: "23a368f5609cecf8ab3ada4363684dc9"
server_key_iv: "2370a2a39c43b5b14fb2549198015f05"
server_key_version: "encryptionkey@0"
I20260811 05:04:19.096351 558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:19.107071 558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:19.107854 558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:19.108078 558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:19.116022 558 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:32985
I20260811 05:04:19.116180 631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:32985 every 8 connection(s)
I20260811 05:04:19.117158 558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:04:19.120816 632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:04:19.123210 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 558
I20260811 05:04:19.123468 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:04:19.123773 22727 external_mini_cluster.cc:1428] Setting key 098942df4ab6c6d28110f069494267e3
I20260811 05:04:19.128002 632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f: Bootstrap starting.
I20260811 05:04:19.130858 632 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f: Neither blocks nor log segments found. Creating new log.
I20260811 05:04:19.131703 632 log.cc:824] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f: Log is configured to *not* fsync() on all Append() calls
I20260811 05:04:19.134485 632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f: No bootstrap required, opened a new log
I20260811 05:04:19.135255 635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:19.125379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47544 (local address 127.22.49.254:32985)
0811 05:04:19.126153 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:19.126173 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:19.126217 (+ 44us) server_negotiation.cc:407] Connection header received
0811 05:04:19.127135 (+ 918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:19.127162 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:19.127689 (+ 527us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:19.128089 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:19.128548 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:19.130086 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:19.131161 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:19.131703 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:19.131898 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:19.132893 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:19.132901 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:19.132922 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:04:19.133554 (+ 632us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:19.133637 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:04:19.133665 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:19.133775 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:19.133925 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 05:04:19.134245 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":143,"threads_started":1}
I20260811 05:04:19.139117 632 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a9307df7de4afdbdf78c224c286a4f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 32985 } }
I20260811 05:04:19.139400 632 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:04:19.139467 632 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64a9307df7de4afdbdf78c224c286a4f, State: Initialized, Role: FOLLOWER
I20260811 05:04:19.139884 632 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a9307df7de4afdbdf78c224c286a4f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 32985 } }
I20260811 05:04:19.140065 632 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:04:19.140156 632 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:04:19.140259 632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:04:19.141353 632 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a9307df7de4afdbdf78c224c286a4f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 32985 } }
I20260811 05:04:19.141713 632 leader_election.cc:302] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64a9307df7de4afdbdf78c224c286a4f; no voters:
I20260811 05:04:19.142053 632 leader_election.cc:288] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:04:19.142234 637 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:04:19.142489 637 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [term 1 LEADER]: Becoming Leader. State: Replica: 64a9307df7de4afdbdf78c224c286a4f, State: Running, Role: LEADER
I20260811 05:04:19.142870 637 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a9307df7de4afdbdf78c224c286a4f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 32985 } }
I20260811 05:04:19.143599 632 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:04:19.144177 637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64a9307df7de4afdbdf78c224c286a4f. Latest consensus state: current_term: 1 leader_uuid: "64a9307df7de4afdbdf78c224c286a4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a9307df7de4afdbdf78c224c286a4f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 32985 } } }
I20260811 05:04:19.144345 637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [sys.catalog]: This master's current role is: LEADER
I20260811 05:04:19.144795 644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:04:19.144742 638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64a9307df7de4afdbdf78c224c286a4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a9307df7de4afdbdf78c224c286a4f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 32985 } } }
I20260811 05:04:19.145022 638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f [sys.catalog]: This master's current role is: LEADER
I20260811 05:04:19.148113 644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:04:19.154002 644 catalog_manager.cc:1347] Generated new cluster ID: 619944fb49a0497ba947c41651b8678a
I20260811 05:04:19.154170 644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:04:19.170080 644 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:04:19.171589 644 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:04:19.186811 644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64a9307df7de4afdbdf78c224c286a4f: Generated new TSK 0
I20260811 05:04:19.187888 644 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:04:19.196462 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:32985
--builtin_ntp_servers=127.22.49.212:46827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 05:04:19.318334 659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:19.318640 659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:19.318679 659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:19.323032 659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:19.323127 659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:19.323186 659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:04:19.328327 659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:46827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:32985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:19.329485 659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:19.330922 659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:19.341295 668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:19.341259 665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:19.341300 666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:19.341619 659 server_base.cc:1034] running on GCE node
I20260811 05:04:19.342087 659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:19.342844 659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:19.344041 659 hybrid_clock.cc:648] HybridClock initialized: now 1786424659343998 us; error 51 us; skew 500 ppm
I20260811 05:04:19.346469 659 webserver.cc:460] Webserver started at http://127.22.49.193:35645/ using document root <none> and password file <none>
I20260811 05:04:19.347183 659 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:19.347255 659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:19.347488 659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:19.349759 659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "67f182c5f2964fb5a7d88405c5b746d1"
format_stamp: "Formatted at 2026-08-11 05:04:19 on dist-test-slave-w206"
server_key: "0f73b6b7a6da760ee9650c8f5846697a"
server_key_iv: "45d9303e8c8c984fa58e2e98c29294ad"
server_key_version: "encryptionkey@0"
I20260811 05:04:19.350389 659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "67f182c5f2964fb5a7d88405c5b746d1"
format_stamp: "Formatted at 2026-08-11 05:04:19 on dist-test-slave-w206"
server_key: "0f73b6b7a6da760ee9650c8f5846697a"
server_key_iv: "45d9303e8c8c984fa58e2e98c29294ad"
server_key_version: "encryptionkey@0"
I20260811 05:04:19.355252 659 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.003s
I20260811 05:04:19.358395 675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:19.360030 659 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:04:19.360219 659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "67f182c5f2964fb5a7d88405c5b746d1"
format_stamp: "Formatted at 2026-08-11 05:04:19 on dist-test-slave-w206"
server_key: "0f73b6b7a6da760ee9650c8f5846697a"
server_key_iv: "45d9303e8c8c984fa58e2e98c29294ad"
server_key_version: "encryptionkey@0"
I20260811 05:04:19.360371 659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:19.377339 659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:19.378180 659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:19.378405 659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:19.379078 659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:04:19.380131 659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:04:19.380205 659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:19.380277 659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:04:19.380318 659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:19.390638 659 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:41611
I20260811 05:04:19.390698 797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:41611 every 8 connection(s)
I20260811 05:04:19.391731 659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:04:19.394901 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 659
I20260811 05:04:19.395061 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:04:19.395434 22727 external_mini_cluster.cc:1428] Setting key 25599c9d8cf05c24c34f26a5726c4350
I20260811 05:04:19.397903 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:32985
--builtin_ntp_servers=127.22.49.212:46827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 05:04:19.403417 635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:19.393805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:48129 (local address 127.22.49.254:32985)
0811 05:04:19.393964 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:19.393968 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:19.395180 (+ 1212us) server_negotiation.cc:407] Connection header received
0811 05:04:19.396891 (+ 1711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:19.396894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:19.396944 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:19.397025 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:19.398019 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:19.399009 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:19.400758 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:19.401072 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:19.401174 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:19.402717 (+ 1543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:19.402720 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:19.402722 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:04:19.402739 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:19.402760 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:04:19.402769 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:19.402911 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:19.403179 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 05:04:19.403252 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 05:04:19.404898 801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:19.394229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:32985 (local address 127.22.49.193:48129)
0811 05:04:19.394939 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:19.395070 (+ 131us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:19.396652 (+ 1582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:19.397236 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:19.397243 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:19.397331 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:19.397848 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:19.397860 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:19.399143 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:19.399146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:19.400571 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:19.400587 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:19.401267 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:19.401273 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:19.401545 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:19.402312 (+ 767us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:04:19.402317 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:19.402380 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:04:19.402497 (+ 117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:04:19.402931 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:04:19.402944 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:04:19.402953 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 05:04:19.403160 (+ 207us) client_negotiation.cc:240] Negotiation successful
0811 05:04:19.403580 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":131,"threads_started":1}
I20260811 05:04:19.406479 798 heartbeater.cc:347] Connected to a master server at 127.22.49.254:32985
I20260811 05:04:19.406831 798 heartbeater.cc:464] Registering TS with master...
I20260811 05:04:19.407497 798 heartbeater.cc:511] Master 127.22.49.254:32985 requested a full tablet report, sending...
I20260811 05:04:19.409372 595 ts_manager.cc:194] Registered new tserver with Master: 67f182c5f2964fb5a7d88405c5b746d1 (127.22.49.193:41611)
I20260811 05:04:19.410914 595 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.49.193:48129
W20260811 05:04:19.528630 802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:19.529021 802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:19.529114 802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:19.535432 802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:19.535584 802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:19.535712 802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:04:19.542448 802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:46827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:32985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:19.544564 802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:19.546281 802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:19.557368 808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:19.557392 811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:19.557394 809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:19.557685 802 server_base.cc:1034] running on GCE node
I20260811 05:04:19.558171 802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:19.558835 802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:19.560020 802 hybrid_clock.cc:648] HybridClock initialized: now 1786424659560002 us; error 32 us; skew 500 ppm
I20260811 05:04:19.562045 802 webserver.cc:460] Webserver started at http://127.22.49.194:43351/ using document root <none> and password file <none>
I20260811 05:04:19.562670 802 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:19.562738 802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:19.563006 802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:19.565488 802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "e1105ddd78a04bfe910f2ae31c235a68"
format_stamp: "Formatted at 2026-08-11 05:04:19 on dist-test-slave-w206"
server_key: "de4395ba2219d3f691f64d89f690eee0"
server_key_iv: "905caed36496988a46c56bae8188c6bb"
server_key_version: "encryptionkey@0"
I20260811 05:04:19.566120 802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "e1105ddd78a04bfe910f2ae31c235a68"
format_stamp: "Formatted at 2026-08-11 05:04:19 on dist-test-slave-w206"
server_key: "de4395ba2219d3f691f64d89f690eee0"
server_key_iv: "905caed36496988a46c56bae8188c6bb"
server_key_version: "encryptionkey@0"
I20260811 05:04:19.570407 802 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 05:04:19.573693 817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:19.575717 802 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 05:04:19.575873 802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "e1105ddd78a04bfe910f2ae31c235a68"
format_stamp: "Formatted at 2026-08-11 05:04:19 on dist-test-slave-w206"
server_key: "de4395ba2219d3f691f64d89f690eee0"
server_key_iv: "905caed36496988a46c56bae8188c6bb"
server_key_version: "encryptionkey@0"
I20260811 05:04:19.576059 802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:19.591822 802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:19.592670 802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:19.592893 802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:19.593557 802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:04:19.594570 802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:04:19.594659 802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:19.594729 802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:04:19.594784 802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:19.604827 802 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:43543
I20260811 05:04:19.604875 942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:43543 every 8 connection(s)
I20260811 05:04:19.605914 802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:04:19.608358 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 802
I20260811 05:04:19.608521 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:04:19.608853 22727 external_mini_cluster.cc:1428] Setting key f469bf900833f9dcbbdc67a3dcbac4ca
I20260811 05:04:19.611455 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:32985
--builtin_ntp_servers=127.22.49.212:46827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 05:04:19.617726 635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:19.608197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:39351 (local address 127.22.49.254:32985)
0811 05:04:19.608375 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:19.608380 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:19.609813 (+ 1433us) server_negotiation.cc:407] Connection header received
0811 05:04:19.611659 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:19.611665 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:19.611730 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:19.611830 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:19.613166 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:19.613810 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:19.615478 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:19.615700 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:19.615904 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:19.617185 (+ 1281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:19.617188 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:19.617190 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:04:19.617205 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:19.617225 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:04:19.617233 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:19.617313 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:19.617502 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 05:04:19.617571 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 05:04:19.618682 945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:19.608777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:32985 (local address 127.22.49.194:39351)
0811 05:04:19.609625 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:19.609684 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:19.611373 (+ 1689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:19.612070 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:19.612083 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:19.612211 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:19.612971 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:19.612995 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:19.613964 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:19.613969 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:19.615323 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:19.615334 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:19.615955 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:19.615959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:19.616151 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:19.616876 (+ 725us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:04:19.616878 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:19.616921 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:04:19.616997 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:04:19.617327 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:04:19.617339 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:04:19.617345 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 05:04:19.617501 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 05:04:19.617826 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":148,"threads_started":1}
I20260811 05:04:19.620050 943 heartbeater.cc:347] Connected to a master server at 127.22.49.254:32985
I20260811 05:04:19.620352 943 heartbeater.cc:464] Registering TS with master...
I20260811 05:04:19.621106 943 heartbeater.cc:511] Master 127.22.49.254:32985 requested a full tablet report, sending...
I20260811 05:04:19.622515 595 ts_manager.cc:194] Registered new tserver with Master: e1105ddd78a04bfe910f2ae31c235a68 (127.22.49.194:43543)
I20260811 05:04:19.623482 595 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.49.194:39351
W20260811 05:04:19.736469 946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:19.736779 946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:19.736819 946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:19.741230 946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:19.741300 946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:19.741364 946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:04:19.746565 946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:46827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:32985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:19.747776 946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:19.749156 946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:19.759323 952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:19.759326 951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:19.759290 954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:19.759395 946 server_base.cc:1034] running on GCE node
I20260811 05:04:19.759987 946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:19.760686 946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:19.761909 946 hybrid_clock.cc:648] HybridClock initialized: now 1786424659761894 us; error 28 us; skew 500 ppm
I20260811 05:04:19.764194 946 webserver.cc:460] Webserver started at http://127.22.49.195:42973/ using document root <none> and password file <none>
I20260811 05:04:19.764882 946 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:19.764951 946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:19.765199 946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:19.767475 946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "2e254b3b4b044b60aba4cbaa0f457c1e"
format_stamp: "Formatted at 2026-08-11 05:04:19 on dist-test-slave-w206"
server_key: "78ffd96c0bcd3f5716b42537c40bb9a0"
server_key_iv: "9c478e69fa8484c6d0a1e378b402bc1d"
server_key_version: "encryptionkey@0"
I20260811 05:04:19.768080 946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "2e254b3b4b044b60aba4cbaa0f457c1e"
format_stamp: "Formatted at 2026-08-11 05:04:19 on dist-test-slave-w206"
server_key: "78ffd96c0bcd3f5716b42537c40bb9a0"
server_key_iv: "9c478e69fa8484c6d0a1e378b402bc1d"
server_key_version: "encryptionkey@0"
I20260811 05:04:19.772089 946 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:04:19.774956 960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:19.776582 946 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:04:19.776729 946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "2e254b3b4b044b60aba4cbaa0f457c1e"
format_stamp: "Formatted at 2026-08-11 05:04:19 on dist-test-slave-w206"
server_key: "78ffd96c0bcd3f5716b42537c40bb9a0"
server_key_iv: "9c478e69fa8484c6d0a1e378b402bc1d"
server_key_version: "encryptionkey@0"
I20260811 05:04:19.776872 946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:19.793689 946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:19.794549 946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:19.794796 946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:19.795521 946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:04:19.796641 946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:04:19.796694 946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:19.796741 946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:04:19.796811 946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:19.807427 946 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:46549
I20260811 05:04:19.807513 1080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:46549 every 8 connection(s)
I20260811 05:04:19.808605 946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:04:19.811120 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 946
I20260811 05:04:19.811215 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:04:19.811532 22727 external_mini_cluster.cc:1428] Setting key 52d5f34621e7157d3c9e0f1dee21938a
I20260811 05:04:19.819866 635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:19.810887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:36911 (local address 127.22.49.254:32985)
0811 05:04:19.811113 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:19.811119 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:19.812565 (+ 1446us) server_negotiation.cc:407] Connection header received
0811 05:04:19.814227 (+ 1662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:19.814231 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:19.814296 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:19.814385 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:19.815528 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:19.816132 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:19.817506 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:19.817774 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:19.817914 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:19.819274 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:19.819277 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:19.819279 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:04:19.819295 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:19.819316 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:04:19.819324 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:19.819412 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:19.819618 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 05:04:19.819695 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260811 05:04:19.820902 1083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:19.811478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:32985 (local address 127.22.49.195:36911)
0811 05:04:19.812383 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:19.812447 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:19.813963 (+ 1516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:19.814587 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:19.814597 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:19.814698 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:19.815325 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:19.815340 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:19.816315 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:19.816318 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:19.817340 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:19.817351 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:19.817970 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:19.817975 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:19.818184 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:19.818904 (+ 720us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:04:19.818905 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:19.818962 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:04:19.819068 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:04:19.819427 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:04:19.819440 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:04:19.819448 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 05:04:19.819598 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 05:04:19.819927 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":180,"threads_started":1}
I20260811 05:04:19.822229 1081 heartbeater.cc:347] Connected to a master server at 127.22.49.254:32985
I20260811 05:04:19.822552 1081 heartbeater.cc:464] Registering TS with master...
I20260811 05:04:19.823196 1081 heartbeater.cc:511] Master 127.22.49.254:32985 requested a full tablet report, sending...
I20260811 05:04:19.824518 595 ts_manager.cc:194] Registered new tserver with Master: 2e254b3b4b044b60aba4cbaa0f457c1e (127.22.49.195:46549)
I20260811 05:04:19.825232 595 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.49.195:36911
I20260811 05:04:19.825842 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 05:04:19.828912 635 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:19.827947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47548 (local address 127.22.49.254:32985)
0811 05:04:19.828097 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:19.828102 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:19.828284 (+ 182us) server_negotiation.cc:407] Connection header received
0811 05:04:19.828389 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:19.828391 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:19.828430 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:19.828497 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:19.828767 (+ 270us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47548: BlockingRecv error: recv got EOF from 127.0.0.1:47548 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 05:04:19.829089 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 659
I20260811 05:04:19.841048 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 802
I20260811 05:04:19.850318 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 946
I20260811 05:04:19.859654 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 558
2026-08-11T05:04:19Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (960 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T05:04:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:04:19Z Disabled control of system clock
I20260811 05:04:19.894520 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:42079
--webserver_interface=127.22.49.254
--webserver_port=0
--builtin_ntp_servers=127.22.49.212:40367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:42079
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 05:04:20.014496 1092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:20.014833 1092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:20.014875 1092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:20.019237 1092 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:04:20.019320 1092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:20.019336 1092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:20.019356 1092 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:04:20.019371 1092 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:04:20.025218 1092 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:40367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:42079
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:42079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:20.026500 1092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:20.028067 1092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:20.037442 1098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:20.037436 1099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:20.037438 1103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:20.037761 1092 server_base.cc:1034] running on GCE node
I20260811 05:04:20.038499 1092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:20.039772 1092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:20.040920 1092 hybrid_clock.cc:648] HybridClock initialized: now 1786424660040870 us; error 65 us; skew 500 ppm
I20260811 05:04:20.043255 1092 webserver.cc:460] Webserver started at http://127.22.49.254:40139/ using document root <none> and password file <none>
I20260811 05:04:20.043963 1092 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:20.044049 1092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:20.044328 1092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:20.046818 1092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "17c8a00a8f414586a375ccfc9a224948"
format_stamp: "Formatted at 2026-08-11 05:04:20 on dist-test-slave-w206"
server_key: "65478e3229f6f113b329fd05bd92db6f"
server_key_iv: "482d87a3da1272fa455dd02e8c8ed047"
server_key_version: "encryptionkey@0"
I20260811 05:04:20.047591 1092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "17c8a00a8f414586a375ccfc9a224948"
format_stamp: "Formatted at 2026-08-11 05:04:20 on dist-test-slave-w206"
server_key: "65478e3229f6f113b329fd05bd92db6f"
server_key_iv: "482d87a3da1272fa455dd02e8c8ed047"
server_key_version: "encryptionkey@0"
I20260811 05:04:20.051653 1092 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:04:20.054314 1110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:20.055860 1092 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:04:20.056046 1092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "17c8a00a8f414586a375ccfc9a224948"
format_stamp: "Formatted at 2026-08-11 05:04:20 on dist-test-slave-w206"
server_key: "65478e3229f6f113b329fd05bd92db6f"
server_key_iv: "482d87a3da1272fa455dd02e8c8ed047"
server_key_version: "encryptionkey@0"
I20260811 05:04:20.056192 1092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:20.061316 1092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:20.062060 1092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:20.062268 1092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:20.069738 1092 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:42079
I20260811 05:04:20.069773 1168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:42079 every 8 connection(s)
I20260811 05:04:20.070778 1092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:04:20.071900 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 1092
I20260811 05:04:20.072014 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:04:20.072345 22727 external_mini_cluster.cc:1428] Setting key 4f6da41803dcdb399903d72f97b8f145
I20260811 05:04:20.074378 1169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:04:20.079303 1172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:20.073873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52180 (local address 127.22.49.254:42079)
0811 05:04:20.075052 (+ 1179us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:20.075072 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:20.075115 (+ 43us) server_negotiation.cc:407] Connection header received
0811 05:04:20.076014 (+ 899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:20.076037 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:20.076489 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:20.076871 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:20.077708 (+ 837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:20.077715 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:20.077732 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:04:20.077745 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:20.077823 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:04:20.077847 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:20.077995 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:20.078073 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 05:04:20.078341 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":715,"thread_start_us":557,"threads_started":1}
I20260811 05:04:20.081773 1169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948: Bootstrap starting.
I20260811 05:04:20.084112 1169 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948: Neither blocks nor log segments found. Creating new log.
I20260811 05:04:20.084913 1169 log.cc:824] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948: Log is configured to *not* fsync() on all Append() calls
I20260811 05:04:20.087296 1169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948: No bootstrap required, opened a new log
I20260811 05:04:20.090863 1169 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17c8a00a8f414586a375ccfc9a224948" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42079 } }
I20260811 05:04:20.091181 1169 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:04:20.091269 1169 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17c8a00a8f414586a375ccfc9a224948, State: Initialized, Role: FOLLOWER
I20260811 05:04:20.091746 1169 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17c8a00a8f414586a375ccfc9a224948" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42079 } }
I20260811 05:04:20.091871 1169 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:04:20.091941 1169 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:04:20.092042 1169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:04:20.093146 1169 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17c8a00a8f414586a375ccfc9a224948" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42079 } }
I20260811 05:04:20.093536 1169 leader_election.cc:302] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17c8a00a8f414586a375ccfc9a224948; no voters:
I20260811 05:04:20.093888 1169 leader_election.cc:288] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:04:20.094025 1174 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:04:20.094347 1174 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [term 1 LEADER]: Becoming Leader. State: Replica: 17c8a00a8f414586a375ccfc9a224948, State: Running, Role: LEADER
I20260811 05:04:20.094655 1174 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17c8a00a8f414586a375ccfc9a224948" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42079 } }
I20260811 05:04:20.095278 1169 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:04:20.096479 1176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17c8a00a8f414586a375ccfc9a224948. Latest consensus state: current_term: 1 leader_uuid: "17c8a00a8f414586a375ccfc9a224948" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17c8a00a8f414586a375ccfc9a224948" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42079 } } }
I20260811 05:04:20.096493 1175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17c8a00a8f414586a375ccfc9a224948" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17c8a00a8f414586a375ccfc9a224948" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42079 } } }
I20260811 05:04:20.096613 1176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [sys.catalog]: This master's current role is: LEADER
I20260811 05:04:20.096616 1175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948 [sys.catalog]: This master's current role is: LEADER
I20260811 05:04:20.097035 1183 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:04:20.100572 1183 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:04:20.106150 1183 catalog_manager.cc:1347] Generated new cluster ID: 52e055d8459c43a985db70fcfcf239b1
I20260811 05:04:20.106251 1183 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:04:20.146205 1183 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:04:20.147198 1183 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:04:20.156240 1183 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 17c8a00a8f414586a375ccfc9a224948: Generated new TSK 0
I20260811 05:04:20.157413 1183 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:04:20.169405 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:42079
--builtin_ntp_servers=127.22.49.212:40367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 05:04:20.305068 1195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:20.305408 1195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:20.305452 1195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:20.309911 1195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:20.310000 1195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:20.310065 1195 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:04:20.316143 1195 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:40367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:42079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:20.317842 1195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:20.319458 1195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:20.330600 1200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:20.330574 1201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:20.330578 1203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:20.330965 1195 server_base.cc:1034] running on GCE node
I20260811 05:04:20.331620 1195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:20.332419 1195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:20.333647 1195 hybrid_clock.cc:648] HybridClock initialized: now 1786424660333613 us; error 46 us; skew 500 ppm
I20260811 05:04:20.336023 1195 webserver.cc:460] Webserver started at http://127.22.49.193:37027/ using document root <none> and password file <none>
I20260811 05:04:20.336771 1195 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:20.336885 1195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:20.337149 1195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:20.339949 1195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "37d881b81fd74f5dabcf500dd68c412b"
format_stamp: "Formatted at 2026-08-11 05:04:20 on dist-test-slave-w206"
server_key: "338a94781ebee97db1f8d44bc86f271a"
server_key_iv: "e595f5637a148cea70bca564308bae1a"
server_key_version: "encryptionkey@0"
I20260811 05:04:20.340628 1195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "37d881b81fd74f5dabcf500dd68c412b"
format_stamp: "Formatted at 2026-08-11 05:04:20 on dist-test-slave-w206"
server_key: "338a94781ebee97db1f8d44bc86f271a"
server_key_iv: "e595f5637a148cea70bca564308bae1a"
server_key_version: "encryptionkey@0"
I20260811 05:04:20.345032 1195 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:04:20.348235 1210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:20.349876 1195 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:04:20.350080 1195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "37d881b81fd74f5dabcf500dd68c412b"
format_stamp: "Formatted at 2026-08-11 05:04:20 on dist-test-slave-w206"
server_key: "338a94781ebee97db1f8d44bc86f271a"
server_key_iv: "e595f5637a148cea70bca564308bae1a"
server_key_version: "encryptionkey@0"
I20260811 05:04:20.350246 1195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:20.355664 1195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:20.356403 1195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:20.356631 1195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:20.357254 1195 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:04:20.358296 1195 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:04:20.358372 1195 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:20.358453 1195 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:04:20.358498 1195 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:20.368830 1195 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:38271
I20260811 05:04:20.368863 1335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:38271 every 8 connection(s)
I20260811 05:04:20.369830 1195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:04:20.372165 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 1195
I20260811 05:04:20.372289 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:04:20.372622 22727 external_mini_cluster.cc:1428] Setting key 19a0be523494c3579bd2fe61e2450d30
I20260811 05:04:20.374955 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:42079
--builtin_ntp_servers=127.22.49.212:40367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 05:04:20.377270 1172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:20.371901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:44901 (local address 127.22.49.254:42079)
0811 05:04:20.372079 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:20.372085 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:20.373336 (+ 1251us) server_negotiation.cc:407] Connection header received
0811 05:04:20.375133 (+ 1797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:20.375138 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:20.375192 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:20.375292 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:20.376785 (+ 1493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:20.376788 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:20.376791 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:04:20.376817 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:20.376836 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:04:20.376843 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:20.376946 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:20.377088 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 05:04:20.377136 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 05:04:20.378194 1338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:20.372357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:42079 (local address 127.22.49.193:44901)
0811 05:04:20.373151 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:20.373216 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:20.374789 (+ 1573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:20.375500 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:20.375512 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:20.375641 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:20.376461 (+ 820us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:04:20.376465 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:20.376542 (+ 77us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:04:20.376641 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:04:20.376929 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:04:20.376939 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:04:20.376945 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 05:04:20.377129 (+ 184us) client_negotiation.cc:240] Negotiation successful
0811 05:04:20.377396 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":130,"threads_started":1}
I20260811 05:04:20.379544 1336 heartbeater.cc:347] Connected to a master server at 127.22.49.254:42079
I20260811 05:04:20.379756 1336 heartbeater.cc:464] Registering TS with master...
I20260811 05:04:20.380175 1336 heartbeater.cc:511] Master 127.22.49.254:42079 requested a full tablet report, sending...
I20260811 05:04:20.381810 1129 ts_manager.cc:194] Registered new tserver with Master: 37d881b81fd74f5dabcf500dd68c412b (127.22.49.193:38271)
W20260811 05:04:20.503901 1339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:20.504451 1339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:20.504981 1339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:20.510175 1339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:20.510355 1339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:20.510493 1339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:04:20.516741 1339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:40367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:42079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:20.518147 1339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:20.519889 1339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:20.532691 1346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:20.532717 1345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:20.532691 1348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:20.533073 1339 server_base.cc:1034] running on GCE node
I20260811 05:04:20.534021 1339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:20.534852 1339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:20.536159 1339 hybrid_clock.cc:648] HybridClock initialized: now 1786424660536031 us; error 76 us; skew 500 ppm
I20260811 05:04:20.538537 1339 webserver.cc:460] Webserver started at http://127.22.49.194:42223/ using document root <none> and password file <none>
I20260811 05:04:20.539584 1339 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:20.539765 1339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:20.540346 1339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:20.543262 1339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "312ab910393948699bf7d00d785ab85d"
format_stamp: "Formatted at 2026-08-11 05:04:20 on dist-test-slave-w206"
server_key: "424857eca7bf4bb7e6fec30c48a55b46"
server_key_iv: "bc4a1ddc04d08b10884eb4b174f46dac"
server_key_version: "encryptionkey@0"
I20260811 05:04:20.544005 1339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "312ab910393948699bf7d00d785ab85d"
format_stamp: "Formatted at 2026-08-11 05:04:20 on dist-test-slave-w206"
server_key: "424857eca7bf4bb7e6fec30c48a55b46"
server_key_iv: "bc4a1ddc04d08b10884eb4b174f46dac"
server_key_version: "encryptionkey@0"
I20260811 05:04:20.548444 1339 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:04:20.551805 1355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:20.553376 1339 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:04:20.553570 1339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "312ab910393948699bf7d00d785ab85d"
format_stamp: "Formatted at 2026-08-11 05:04:20 on dist-test-slave-w206"
server_key: "424857eca7bf4bb7e6fec30c48a55b46"
server_key_iv: "bc4a1ddc04d08b10884eb4b174f46dac"
server_key_version: "encryptionkey@0"
I20260811 05:04:20.553740 1339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:20.559151 1339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:20.560003 1339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:20.560226 1339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:20.560935 1339 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:04:20.562002 1339 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:04:20.562053 1339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:20.562095 1339 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:04:20.562110 1339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:20.574136 1339 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:36221
I20260811 05:04:20.574220 1477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:36221 every 8 connection(s)
I20260811 05:04:20.575384 1339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:04:20.582443 1172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:20.577513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:60675 (local address 127.22.49.254:42079)
0811 05:04:20.577663 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:20.577666 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:20.578943 (+ 1277us) server_negotiation.cc:407] Connection header received
0811 05:04:20.580372 (+ 1429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:20.580376 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:20.580426 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:20.580536 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:20.581920 (+ 1384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:20.581923 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:20.581925 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:04:20.581939 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:20.581961 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:04:20.581970 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:20.582082 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:20.582237 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 05:04:20.582292 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:04:20.583557 1480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:20.577902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:42079 (local address 127.22.49.194:60675)
0811 05:04:20.578774 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:20.578819 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:20.580136 (+ 1317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:20.580713 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:20.580720 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:20.580815 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:20.581472 (+ 657us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:04:20.581474 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:20.581597 (+ 123us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:04:20.581683 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:04:20.582060 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:04:20.582070 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:04:20.582076 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 05:04:20.582288 (+ 212us) client_negotiation.cc:240] Negotiation successful
0811 05:04:20.582620 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":126,"threads_started":1}
I20260811 05:04:20.584745 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 1339
I20260811 05:04:20.584875 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:04:20.584903 1478 heartbeater.cc:347] Connected to a master server at 127.22.49.254:42079
I20260811 05:04:20.585158 1478 heartbeater.cc:464] Registering TS with master...
I20260811 05:04:20.585217 22727 external_mini_cluster.cc:1428] Setting key 68627dc68d95619dccd4e926628f716c
I20260811 05:04:20.585685 1478 heartbeater.cc:511] Master 127.22.49.254:42079 requested a full tablet report, sending...
I20260811 05:04:20.586874 1129 ts_manager.cc:194] Registered new tserver with Master: 312ab910393948699bf7d00d785ab85d (127.22.49.194:36221)
I20260811 05:04:20.587419 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:42079
--builtin_ntp_servers=127.22.49.212:40367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 05:04:20.710773 1481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:20.711416 1481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:20.711561 1481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:20.715889 1481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:20.715958 1481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:20.716019 1481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:04:20.721145 1481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:40367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:42079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:20.722383 1481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:20.723835 1481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:20.733898 1488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:20.733871 1487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:20.734069 1481 server_base.cc:1034] running on GCE node
W20260811 05:04:20.733863 1490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:20.734761 1481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:20.735498 1481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:20.736681 1481 hybrid_clock.cc:648] HybridClock initialized: now 1786424660736651 us; error 42 us; skew 500 ppm
I20260811 05:04:20.738754 1481 webserver.cc:460] Webserver started at http://127.22.49.195:44975/ using document root <none> and password file <none>
I20260811 05:04:20.739457 1481 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:20.739529 1481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:20.739866 1481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:20.742282 1481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "4df7f63ab4ed48c79242d20fdc975066"
format_stamp: "Formatted at 2026-08-11 05:04:20 on dist-test-slave-w206"
server_key: "d43c948aa51bcd22fd9a14a33b932569"
server_key_iv: "c9bf9e81c2c2df1d43d00f708e0bdbbb"
server_key_version: "encryptionkey@0"
I20260811 05:04:20.743088 1481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "4df7f63ab4ed48c79242d20fdc975066"
format_stamp: "Formatted at 2026-08-11 05:04:20 on dist-test-slave-w206"
server_key: "d43c948aa51bcd22fd9a14a33b932569"
server_key_iv: "c9bf9e81c2c2df1d43d00f708e0bdbbb"
server_key_version: "encryptionkey@0"
I20260811 05:04:20.747520 1481 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 05:04:20.750643 1497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:20.752310 1481 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:04:20.752512 1481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "4df7f63ab4ed48c79242d20fdc975066"
format_stamp: "Formatted at 2026-08-11 05:04:20 on dist-test-slave-w206"
server_key: "d43c948aa51bcd22fd9a14a33b932569"
server_key_iv: "c9bf9e81c2c2df1d43d00f708e0bdbbb"
server_key_version: "encryptionkey@0"
I20260811 05:04:20.752673 1481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:20.758122 1481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:20.758929 1481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:20.759260 1481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:20.759930 1481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:04:20.761107 1481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:04:20.761183 1481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:20.761255 1481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:04:20.761292 1481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:20.771842 1481 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:36939
I20260811 05:04:20.771865 1624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:36939 every 8 connection(s)
I20260811 05:04:20.772944 1481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:04:20.775964 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 1481
I20260811 05:04:20.776098 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:04:20.776393 22727 external_mini_cluster.cc:1428] Setting key fe16bea08f31e708d7b03e8911b90f43
I20260811 05:04:20.780805 1172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:20.775091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:34095 (local address 127.22.49.254:42079)
0811 05:04:20.775237 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:20.775241 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:20.776663 (+ 1422us) server_negotiation.cc:407] Connection header received
0811 05:04:20.778543 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:20.778547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:20.778625 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:20.778722 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:20.780289 (+ 1567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:20.780293 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:20.780296 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:04:20.780312 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:20.780336 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:04:20.780345 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:20.780435 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:20.780629 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 05:04:20.780676 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 05:04:20.781896 1628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:20.775609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:42079 (local address 127.22.49.195:34095)
0811 05:04:20.776464 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:20.776529 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:20.778226 (+ 1697us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:20.779180 (+ 954us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:20.779188 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:20.779339 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:20.779990 (+ 651us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:04:20.779992 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:20.780039 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:04:20.780117 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:04:20.780466 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:04:20.780476 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:04:20.780481 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:04:20.780664 (+ 183us) client_negotiation.cc:240] Negotiation successful
0811 05:04:20.780921 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":179,"threads_started":1}
I20260811 05:04:20.783294 1625 heartbeater.cc:347] Connected to a master server at 127.22.49.254:42079
I20260811 05:04:20.783576 1625 heartbeater.cc:464] Registering TS with master...
I20260811 05:04:20.784092 1625 heartbeater.cc:511] Master 127.22.49.254:42079 requested a full tablet report, sending...
I20260811 05:04:20.785460 1129 ts_manager.cc:194] Registered new tserver with Master: 4df7f63ab4ed48c79242d20fdc975066 (127.22.49.195:36939)
I20260811 05:04:20.791556 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 05:04:20.795019 1172 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:04:20.793832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52194 (local address 127.22.49.254:42079)
0811 05:04:20.794002 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:20.794008 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:20.794187 (+ 179us) server_negotiation.cc:407] Connection header received
0811 05:04:20.794335 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:20.794337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:20.794378 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:20.794452 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:20.794793 (+ 341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52194: BlockingRecv error: recv got EOF from 127.0.0.1:52194 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 05:04:20.795233 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 1195
I20260811 05:04:20.807724 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 1339
I20260811 05:04:20.816965 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 1481
I20260811 05:04:20.826125 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 1092
2026-08-11T05:04:20Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (967 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:04:20 dist-test-slave-w206 krb5kdc[1636](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:04:20 dist-test-slave-w206 krb5kdc[1636](info): set up 2 sockets
Aug 11 05:04:20 dist-test-slave-w206 krb5kdc[1636](info): commencing operation
krb5kdc: starting...
W20260811 05:04:21.970760 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:04:22 dist-test-slave-w206 krb5kdc[1636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:04:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:04:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:04:22.114609 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:45793
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:37957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:45793
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:04:22.233795 1649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:22.234133 1649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:22.234225 1649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:22.240520 1649 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:04:22.240636 1649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:22.240674 1649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:22.240712 1649 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:04:22.240746 1649 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:04:22.246666 1649 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:37957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:45793
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:45793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:22.247963 1649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:22.249035 1649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:22.257952 1655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:22.257973 1658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:22.257963 1654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:22.258317 1649 server_base.cc:1034] running on GCE node
I20260811 05:04:22.258963 1649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:22.260200 1649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:22.261405 1649 hybrid_clock.cc:648] HybridClock initialized: now 1786424662261394 us; error 39 us; skew 500 ppm
Aug 11 05:04:22 dist-test-slave-w206 krb5kdc[1636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424662, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:04:22.264489 1649 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:04:22.265492 1649 webserver.cc:460] Webserver started at http://127.22.49.254:45815/ using document root <none> and password file <none>
I20260811 05:04:22.266088 1649 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:22.266187 1649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:22.266433 1649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:22.268620 1649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "301aed1fd75e45be848675e6cb320202"
format_stamp: "Formatted at 2026-08-11 05:04:22 on dist-test-slave-w206"
server_key: "69a4e8a30cf6396c74dc1f7112a3dbeb"
server_key_iv: "33989927602801e56312031a35313713"
server_key_version: "encryptionkey@0"
I20260811 05:04:22.269214 1649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "301aed1fd75e45be848675e6cb320202"
format_stamp: "Formatted at 2026-08-11 05:04:22 on dist-test-slave-w206"
server_key: "69a4e8a30cf6396c74dc1f7112a3dbeb"
server_key_iv: "33989927602801e56312031a35313713"
server_key_version: "encryptionkey@0"
I20260811 05:04:22.273191 1649 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:04:22.275888 1666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:22.277217 1649 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 05:04:22.277384 1649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "301aed1fd75e45be848675e6cb320202"
format_stamp: "Formatted at 2026-08-11 05:04:22 on dist-test-slave-w206"
server_key: "69a4e8a30cf6396c74dc1f7112a3dbeb"
server_key_iv: "33989927602801e56312031a35313713"
server_key_version: "encryptionkey@0"
I20260811 05:04:22.277513 1649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:22.296559 1649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:22.300196 1649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:22.300428 1649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:22.308388 1649 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:45793
I20260811 05:04:22.308427 1721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:45793 every 8 connection(s)
I20260811 05:04:22.309468 1649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:04:22.312552 1722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:04:22.312947 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 1649
I20260811 05:04:22.313102 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:04:22.313447 22727 external_mini_cluster.cc:1428] Setting key 438ec28926dc13465ef6355b3889f1c1
I20260811 05:04:22.321148 1722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202: Bootstrap starting.
Aug 11 05:04:22 dist-test-slave-w206 krb5kdc[1636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:04:22.324616 1722 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202: Neither blocks nor log segments found. Creating new log.
I20260811 05:04:22.325634 1722 log.cc:824] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202: Log is configured to *not* fsync() on all Append() calls
I20260811 05:04:22.328066 1722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202: No bootstrap required, opened a new log
I20260811 05:04:22.330889 1725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:22.315104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36448 (local address 127.22.49.254:45793)
0811 05:04:22.315712 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:22.315733 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:22.315807 (+ 74us) server_negotiation.cc:407] Connection header received
0811 05:04:22.316817 (+ 1010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:22.316845 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:22.317309 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:22.317707 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:22.318478 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:22.320120 (+ 1642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:22.321064 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:22.321782 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:22.321943 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:22.325225 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:22.325233 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:22.325255 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:04:22.325296 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:22.327425 (+ 2129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:22.328048 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:22.328055 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:22.328061 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:22.328300 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:22.328656 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:22.328659 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:22.328660 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:22.329165 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:22.329339 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:22.329705 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 05:04:22.330088 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":122,"threads_started":1}
I20260811 05:04:22.332397 1722 raft_consensus.cc:348] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301aed1fd75e45be848675e6cb320202" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45793 } }
I20260811 05:04:22.332655 1722 raft_consensus.cc:374] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:04:22.332746 1722 raft_consensus.cc:729] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301aed1fd75e45be848675e6cb320202, State: Initialized, Role: FOLLOWER
I20260811 05:04:22.333244 1722 consensus_queue.cc:260] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301aed1fd75e45be848675e6cb320202" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45793 } }
I20260811 05:04:22.333421 1722 raft_consensus.cc:388] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:04:22.333494 1722 raft_consensus.cc:482] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:04:22.333586 1722 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:04:22.334563 1722 raft_consensus.cc:504] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301aed1fd75e45be848675e6cb320202" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45793 } }
I20260811 05:04:22.334887 1722 leader_election.cc:302] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 301aed1fd75e45be848675e6cb320202; no voters:
I20260811 05:04:22.335253 1722 leader_election.cc:288] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:04:22.335417 1727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:04:22.335659 1727 raft_consensus.cc:686] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [term 1 LEADER]: Becoming Leader. State: Replica: 301aed1fd75e45be848675e6cb320202, State: Running, Role: LEADER
I20260811 05:04:22.335986 1727 consensus_queue.cc:237] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301aed1fd75e45be848675e6cb320202" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45793 } }
I20260811 05:04:22.336596 1722 sys_catalog.cc:564] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:04:22.337831 1729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 301aed1fd75e45be848675e6cb320202. Latest consensus state: current_term: 1 leader_uuid: "301aed1fd75e45be848675e6cb320202" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301aed1fd75e45be848675e6cb320202" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45793 } } }
I20260811 05:04:22.337980 1729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [sys.catalog]: This master's current role is: LEADER
I20260811 05:04:22.338378 1737 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:04:22.338825 1728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "301aed1fd75e45be848675e6cb320202" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301aed1fd75e45be848675e6cb320202" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45793 } } }
I20260811 05:04:22.338943 1728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202 [sys.catalog]: This master's current role is: LEADER
I20260811 05:04:22.341486 1737 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:04:22.348503 1737 catalog_manager.cc:1347] Generated new cluster ID: 2fea6cab2d6c494ba4008212dfc0c91d
I20260811 05:04:22.348623 1737 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:04:22.356086 1737 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:04:22.357162 1737 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:04:22.362661 1737 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202: Generated new TSK 0
I20260811 05:04:22.363510 1737 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:04:22.403735 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45793
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:37957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:04:22.530956 1752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:22.531420 1752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:22.531472 1752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:22.535884 1752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:22.535972 1752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:22.536037 1752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:04:22.542210 1752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:37957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:22.543787 1752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:22.544807 1752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:22.555804 1762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:22.555907 1752 server_base.cc:1034] running on GCE node
W20260811 05:04:22.555790 1759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:22.555809 1758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:22.556629 1752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:22.557426 1752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:22.558676 1752 hybrid_clock.cc:648] HybridClock initialized: now 1786424662558656 us; error 37 us; skew 500 ppm
Aug 11 05:04:22 dist-test-slave-w206 krb5kdc[1636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424662, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:04:22.562115 1752 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:04:22.563205 1752 webserver.cc:460] Webserver started at http://127.22.49.193:37677/ using document root <none> and password file <none>
I20260811 05:04:22.563832 1752 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:22.563934 1752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:22.564193 1752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:22.566452 1752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "6b515c97a36043949a44501830ffb934"
format_stamp: "Formatted at 2026-08-11 05:04:22 on dist-test-slave-w206"
server_key: "8f38bc9edb44e3a50d4f7aa2214c070d"
server_key_iv: "edf92f10efb0f96f96e9451aa78e5674"
server_key_version: "encryptionkey@0"
I20260811 05:04:22.567188 1752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "6b515c97a36043949a44501830ffb934"
format_stamp: "Formatted at 2026-08-11 05:04:22 on dist-test-slave-w206"
server_key: "8f38bc9edb44e3a50d4f7aa2214c070d"
server_key_iv: "edf92f10efb0f96f96e9451aa78e5674"
server_key_version: "encryptionkey@0"
I20260811 05:04:22.571473 1752 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 05:04:22.574400 1770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:22.576375 1752 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:04:22.576586 1752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "6b515c97a36043949a44501830ffb934"
format_stamp: "Formatted at 2026-08-11 05:04:22 on dist-test-slave-w206"
server_key: "8f38bc9edb44e3a50d4f7aa2214c070d"
server_key_iv: "edf92f10efb0f96f96e9451aa78e5674"
server_key_version: "encryptionkey@0"
I20260811 05:04:22.576799 1752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:22.591845 1752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:22.599591 1752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:22.599841 1752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:22.600529 1752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:04:22.601470 1752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:04:22.601547 1752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:22.601621 1752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:04:22.601672 1752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:22.611590 1752 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:37471
I20260811 05:04:22.611613 1893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:37471 every 8 connection(s)
I20260811 05:04:22.612689 1752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:04:22.612932 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 1752
I20260811 05:04:22.613062 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:04:22.613395 22727 external_mini_cluster.cc:1428] Setting key a51296b4f16ec98f276550880b662d27
Aug 11 05:04:22 dist-test-slave-w206 krb5kdc[1636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424662, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
I20260811 05:04:22.630015 1725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:22.616727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:43447 (local address 127.22.49.254:45793)
0811 05:04:22.616924 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:22.616932 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:22.616954 (+ 22us) server_negotiation.cc:407] Connection header received
0811 05:04:22.617902 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:22.617906 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:22.617962 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:22.618073 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:22.619402 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:22.620278 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:22.621759 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:22.622206 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:22.622356 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:22.625466 (+ 3110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:22.625473 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:22.625478 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:04:22.625515 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:22.627145 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:22.627824 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:22.627827 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:22.627829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:22.627929 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:22.628565 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:22.628568 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:22.628569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:22.628800 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:22.628890 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:22.629686 (+ 796us) server_negotiation.cc:299] Negotiation successful
0811 05:04:22.629868 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 05:04:22.631187 1896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:22.615519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:45793 (local address 127.22.49.193:43447)
0811 05:04:22.616146 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:22.616194 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:22.617677 (+ 1483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:22.618257 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:22.618265 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:22.618656 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:22.619243 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:22.619260 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:22.620492 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:22.620496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:22.621606 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:22.621619 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:22.622393 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:22.622396 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:22.622598 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:22.623363 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:22.623382 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:22.625237 (+ 1855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:04:22.627284 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:04:22.627290 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:04:22.627307 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:04:22.627639 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:04:22.628063 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:04:22.628067 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:04:22.628068 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:04:22.628347 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:04:22.628951 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:04:22.628957 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:04:22.629332 (+ 375us) client_negotiation.cc:769] Sending connection context
0811 05:04:22.629577 (+ 245us) client_negotiation.cc:240] Negotiation successful
0811 05:04:22.629940 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":172,"threads_started":1}
I20260811 05:04:22.632728 1894 heartbeater.cc:347] Connected to a master server at 127.22.49.254:45793
I20260811 05:04:22.633008 1894 heartbeater.cc:464] Registering TS with master...
I20260811 05:04:22.633555 1894 heartbeater.cc:511] Master 127.22.49.254:45793 requested a full tablet report, sending...
I20260811 05:04:22.635471 1684 ts_manager.cc:194] Registered new tserver with Master: 6b515c97a36043949a44501830ffb934 (127.22.49.193:37471)
I20260811 05:04:22.636796 1684 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:43447
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:04:22.651786 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45793
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:37957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:04:22.772541 1900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:22.772903 1900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:22.772987 1900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:22.777676 1900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:22.777819 1900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:22.777927 1900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:04:22.784137 1900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:37957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:22.785383 1900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:22.786500 1900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:22.797266 1909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:22.797403 1907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:22.797259 1906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:22.797683 1900 server_base.cc:1034] running on GCE node
I20260811 05:04:22.798271 1900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:22.799126 1900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:22.800384 1900 hybrid_clock.cc:648] HybridClock initialized: now 1786424662800359 us; error 48 us; skew 500 ppm
Aug 11 05:04:22 dist-test-slave-w206 krb5kdc[1636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424662, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:04:22.803645 1900 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:04:22.804666 1900 webserver.cc:460] Webserver started at http://127.22.49.194:38667/ using document root <none> and password file <none>
I20260811 05:04:22.805274 1900 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:22.805378 1900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:22.805625 1900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:22.807875 1900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "c658719ece954f0f96fc1476d029770b"
format_stamp: "Formatted at 2026-08-11 05:04:22 on dist-test-slave-w206"
server_key: "17a02479cdfc709e5d40157ff6189008"
server_key_iv: "f64f2ca54819d16bfd92af3fa850245c"
server_key_version: "encryptionkey@0"
I20260811 05:04:22.808497 1900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "c658719ece954f0f96fc1476d029770b"
format_stamp: "Formatted at 2026-08-11 05:04:22 on dist-test-slave-w206"
server_key: "17a02479cdfc709e5d40157ff6189008"
server_key_iv: "f64f2ca54819d16bfd92af3fa850245c"
server_key_version: "encryptionkey@0"
I20260811 05:04:22.812697 1900 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:04:22.815618 1917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:22.817123 1900 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:04:22.817317 1900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "c658719ece954f0f96fc1476d029770b"
format_stamp: "Formatted at 2026-08-11 05:04:22 on dist-test-slave-w206"
server_key: "17a02479cdfc709e5d40157ff6189008"
server_key_iv: "f64f2ca54819d16bfd92af3fa850245c"
server_key_version: "encryptionkey@0"
I20260811 05:04:22.817474 1900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:22.845772 1900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:22.849812 1900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:22.850061 1900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:22.850786 1900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:04:22.851789 1900 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:04:22.851862 1900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:22.851938 1900 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:04:22.851989 1900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:22.862212 1900 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:38379
I20260811 05:04:22.862232 2041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:38379 every 8 connection(s)
I20260811 05:04:22.863435 1900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:04:22.871227 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 1900
I20260811 05:04:22.871405 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:04:22.871711 22727 external_mini_cluster.cc:1428] Setting key 3d8a0e53e7d65ab4776a3f55dc32ba22
Aug 11 05:04:22 dist-test-slave-w206 krb5kdc[1636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424662, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:04:22.880463 1725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:22.865578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:35559 (local address 127.22.49.254:45793)
0811 05:04:22.865762 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:22.865766 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:22.866771 (+ 1005us) server_negotiation.cc:407] Connection header received
0811 05:04:22.868487 (+ 1716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:22.868491 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:22.868562 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:22.868681 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:22.870145 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:22.870702 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:22.872359 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:22.872670 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:22.872774 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:22.876041 (+ 3267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:22.876045 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:22.876047 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:04:22.876076 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:22.877641 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:22.878422 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:22.878425 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:22.878426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:22.878512 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:22.879076 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:22.879078 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:22.879079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:22.879284 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:22.879376 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:22.880180 (+ 804us) server_negotiation.cc:299] Negotiation successful
0811 05:04:22.880303 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 05:04:22.882057 2044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:22.866017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:45793 (local address 127.22.49.194:35559)
0811 05:04:22.866582 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:22.866634 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:22.868169 (+ 1535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:22.868894 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:22.868903 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:22.869361 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:22.869949 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:22.869967 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:22.870929 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:22.870932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:22.872159 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:22.872173 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:22.872889 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:22.872894 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:22.873140 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:22.874051 (+ 911us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:22.874071 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:22.875804 (+ 1733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:04:22.877795 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:04:22.877805 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:04:22.877829 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:04:22.878269 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:04:22.878623 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:04:22.878629 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:04:22.878634 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:04:22.878876 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:04:22.879417 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:04:22.879425 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:04:22.879850 (+ 425us) client_negotiation.cc:769] Sending connection context
0811 05:04:22.880129 (+ 279us) client_negotiation.cc:240] Negotiation successful
0811 05:04:22.880594 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":153,"threads_started":1}
I20260811 05:04:22.883571 2042 heartbeater.cc:347] Connected to a master server at 127.22.49.254:45793
I20260811 05:04:22.883869 2042 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
I20260811 05:04:22.884536 2042 heartbeater.cc:511] Master 127.22.49.254:45793 requested a full tablet report, sending...
I20260811 05:04:22.885931 1684 ts_manager.cc:194] Registered new tserver with Master: c658719ece954f0f96fc1476d029770b (127.22.49.194:38379)
I20260811 05:04:22.886518 1684 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:35559
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:04:22.907047 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45793
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:37957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:04:23.031806 2047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:04:23.032254 2047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:04:23.032344 2047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:04:23.036834 2047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:04:23.036963 2047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:04:23.037074 2047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:04:23.043206 2047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:37957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:04:23.044469 2047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:04:23.045605 2047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:04:23.056438 2055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:04:23.056524 2052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:23.056512 2047 server_base.cc:1034] running on GCE node
W20260811 05:04:23.056443 2057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:04:23.057247 2047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:04:23.057983 2047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:04:23.059123 2047 hybrid_clock.cc:648] HybridClock initialized: now 1786424663059069 us; error 73 us; skew 500 ppm
Aug 11 05:04:23 dist-test-slave-w206 krb5kdc[1636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424663, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:04:23.062569 2047 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:04:23.064280 2047 webserver.cc:460] Webserver started at http://127.22.49.195:44537/ using document root <none> and password file <none>
I20260811 05:04:23.065114 2047 fs_manager.cc:359] Metadata directory not provided
I20260811 05:04:23.065225 2047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:04:23.065491 2047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:04:23.067953 2047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "86b9ad3830ba40adaf62fc50ec27095f"
format_stamp: "Formatted at 2026-08-11 05:04:23 on dist-test-slave-w206"
server_key: "a49b164de0c152f41fea70b1461a1b8c"
server_key_iv: "a94969cf798d62e2d43e7ba6a0160ab8"
server_key_version: "encryptionkey@0"
I20260811 05:04:23.068617 2047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "86b9ad3830ba40adaf62fc50ec27095f"
format_stamp: "Formatted at 2026-08-11 05:04:23 on dist-test-slave-w206"
server_key: "a49b164de0c152f41fea70b1461a1b8c"
server_key_iv: "a94969cf798d62e2d43e7ba6a0160ab8"
server_key_version: "encryptionkey@0"
I20260811 05:04:23.073031 2047 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:04:23.075878 2065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:23.077155 2047 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:04:23.077366 2047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "86b9ad3830ba40adaf62fc50ec27095f"
format_stamp: "Formatted at 2026-08-11 05:04:23 on dist-test-slave-w206"
server_key: "a49b164de0c152f41fea70b1461a1b8c"
server_key_iv: "a94969cf798d62e2d43e7ba6a0160ab8"
server_key_version: "encryptionkey@0"
I20260811 05:04:23.077502 2047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:04:23.096576 2047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:04:23.100248 2047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:04:23.100553 2047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:04:23.101270 2047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:04:23.102245 2047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:04:23.102324 2047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:23.102418 2047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:04:23.102478 2047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:04:23.112609 2047 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:37447
I20260811 05:04:23.112689 2189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:37447 every 8 connection(s)
I20260811 05:04:23.113718 2047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:04:23.116092 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 2047
I20260811 05:04:23.116253 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:04:23.116618 22727 external_mini_cluster.cc:1428] Setting key 8eb13c67caeb78de35c05a9b6c3031a6
Aug 11 05:04:23 dist-test-slave-w206 krb5kdc[1636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424663, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:04:23.130280 1725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:23.115873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:58415 (local address 127.22.49.254:45793)
0811 05:04:23.116052 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:23.116056 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:23.117188 (+ 1132us) server_negotiation.cc:407] Connection header received
0811 05:04:23.118811 (+ 1623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:23.118814 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:23.118878 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:23.118983 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:23.120232 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.120896 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.122115 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.122392 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.122482 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:23.125592 (+ 3110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:23.125596 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:23.125598 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:04:23.125627 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:23.127282 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:23.127966 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:23.127970 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:23.127971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:23.128063 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:23.128589 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:23.128593 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:23.128594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:23.128863 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:23.128986 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:23.129834 (+ 848us) server_negotiation.cc:299] Negotiation successful
0811 05:04:23.130034 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 05:04:23.131397 2192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:23.116317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:45793 (local address 127.22.49.195:58415)
0811 05:04:23.116978 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:23.117046 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:23.118598 (+ 1552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:23.119176 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:23.119183 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:23.119564 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:04:23.120079 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:23.120093 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.121030 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.121033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:23.121940 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:23.121948 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.122583 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.122587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:23.122751 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:23.123556 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:04:23.123575 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:04:23.125314 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:04:23.127466 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:04:23.127473 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:04:23.127490 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:04:23.127836 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:04:23.128190 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:04:23.128193 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:04:23.128195 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:04:23.128460 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:04:23.129025 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:04:23.129031 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:04:23.129506 (+ 475us) client_negotiation.cc:769] Sending connection context
0811 05:04:23.129756 (+ 250us) client_negotiation.cc:240] Negotiation successful
0811 05:04:23.130163 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":176,"threads_started":1}
I20260811 05:04:23.132694 2190 heartbeater.cc:347] Connected to a master server at 127.22.49.254:45793
I20260811 05:04:23.132941 2190 heartbeater.cc:464] Registering TS with master...
I20260811 05:04:23.133446 2190 heartbeater.cc:511] Master 127.22.49.254:45793 requested a full tablet report, sending...
I20260811 05:04:23.134630 1684 ts_manager.cc:194] Registered new tserver with Master: 86b9ad3830ba40adaf62fc50ec27095f (127.22.49.195:37447)
I20260811 05:04:23.135304 1684 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:58415
I20260811 05:04:23.143755 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:04:23.155167 1725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:23.146053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36454 (local address 127.22.49.254:45793)
0811 05:04:23.146241 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:23.146245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:23.146408 (+ 163us) server_negotiation.cc:407] Connection header received
0811 05:04:23.146597 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:23.146600 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:23.146656 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:23.146746 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:04:23.147662 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.148208 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.149308 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.149548 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.149670 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:23.151487 (+ 1817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:04:23.151491 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:04:23.151493 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:04:23.151527 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:04:23.153208 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:23.153734 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:23.153737 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:23.153739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:23.153828 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:04:23.154138 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:04:23.154142 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:04:23.154143 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:04:23.154411 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:04:23.154567 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:23.154819 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 05:04:23.154958 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 05:04:23.159098 1684 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36454:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:04:23.162521 1684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:04:23.182390 2205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:23.174395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:37471 (local address 127.0.0.1:59302)
0811 05:04:23.175171 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:23.175237 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:23.175414 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:23.176131 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:23.176141 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:23.176173 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:04:23.176349 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:23.176360 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.177797 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.177801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:23.179317 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:23.179330 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.181377 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.181381 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:23.181552 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:23.181617 (+ 65us) client_negotiation.cc:769] Sending connection context
0811 05:04:23.181778 (+ 161us) client_negotiation.cc:240] Negotiation successful
0811 05:04:23.182044 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":125,"threads_started":1}
I20260811 05:04:23.182861 2204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:23.174614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59302 (local address 127.22.49.193:37471)
0811 05:04:23.175551 (+ 937us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:23.175559 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:23.175587 (+ 28us) server_negotiation.cc:407] Connection header received
0811 05:04:23.175672 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:23.175679 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:23.175921 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:23.176544 (+ 623us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:04:23.176715 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.177651 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.179488 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.180989 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.181219 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:23.181478 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:23.182503 (+ 1025us) server_negotiation.cc:299] Negotiation successful
0811 05:04:23.182689 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":813,"thread_start_us":76,"threads_started":1}
I20260811 05:04:23.183321 2203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:23.174662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38379 (local address 127.0.0.1:50196)
0811 05:04:23.175721 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:23.175735 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:23.176199 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:23.176718 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:23.176721 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:23.176741 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:04:23.176868 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:23.176878 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.178468 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.178474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:23.179945 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:23.179958 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.182133 (+ 2175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.182137 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:23.182241 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:23.182264 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 05:04:23.182334 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 05:04:23.183172 (+ 838us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":998,"mutex_wait_us":115,"thread_start_us":103,"threads_started":1}
I20260811 05:04:23.184052 2206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:23.174822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50196 (local address 127.22.49.194:38379)
0811 05:04:23.175296 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:23.175318 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:23.175824 (+ 506us) server_negotiation.cc:407] Connection header received
0811 05:04:23.176417 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:23.176421 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:23.176574 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:23.176742 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:04:23.177006 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.178271 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.180378 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.181635 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.182032 (+ 397us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:23.182303 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:23.182401 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 05:04:23.183880 (+ 1479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":170,"threads_started":1}
I20260811 05:04:23.184120 2207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:23.175444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:37447 (local address 127.0.0.1:41038)
0811 05:04:23.176000 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:23.176014 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:23.176101 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:23.176940 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:23.176943 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:23.176962 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:04:23.177060 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:23.177067 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.178502 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.178505 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:23.179945 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:23.179958 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.183671 (+ 3713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.183678 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:23.183791 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:23.183816 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 05:04:23.183896 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 05:04:23.183981 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"mutex_wait_us":112,"thread_start_us":97,"threads_started":1}
I20260811 05:04:23.184674 2208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:23.175858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41038 (local address 127.22.49.195:37447)
0811 05:04:23.176289 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:23.176301 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:23.176325 (+ 24us) server_negotiation.cc:407] Connection header received
0811 05:04:23.176402 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:23.176407 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:23.176604 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:23.176758 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:04:23.177206 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.178357 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.181719 (+ 3362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.183263 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.183412 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:23.183589 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:23.184371 (+ 782us) server_negotiation.cc:299] Negotiation successful
0811 05:04:23.184493 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":120,"threads_started":1}
I20260811 05:04:23.186472 1819 tablet_service.cc:1467] Processing CreateTablet for tablet 8a05a07ddf3343ac82dde1004128934b (DEFAULT_TABLE table=test-table [id=7e16fcd3524d4ab08bf8e7c85eb1eb18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:04:23.187775 1819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a05a07ddf3343ac82dde1004128934b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:04:23.187927 2117 tablet_service.cc:1467] Processing CreateTablet for tablet 8a05a07ddf3343ac82dde1004128934b (DEFAULT_TABLE table=test-table [id=7e16fcd3524d4ab08bf8e7c85eb1eb18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:04:23.187927 1969 tablet_service.cc:1467] Processing CreateTablet for tablet 8a05a07ddf3343ac82dde1004128934b (DEFAULT_TABLE table=test-table [id=7e16fcd3524d4ab08bf8e7c85eb1eb18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:04:23.189143 2117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a05a07ddf3343ac82dde1004128934b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:04:23.189143 1969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a05a07ddf3343ac82dde1004128934b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:04:23.196213 2209 tablet_bootstrap.cc:492] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934: Bootstrap starting.
I20260811 05:04:23.197849 2210 tablet_bootstrap.cc:492] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f: Bootstrap starting.
I20260811 05:04:23.199226 2211 tablet_bootstrap.cc:492] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b: Bootstrap starting.
I20260811 05:04:23.199906 2209 tablet_bootstrap.cc:654] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934: Neither blocks nor log segments found. Creating new log.
I20260811 05:04:23.200711 2210 tablet_bootstrap.cc:654] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f: Neither blocks nor log segments found. Creating new log.
I20260811 05:04:23.201256 2209 log.cc:824] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934: Log is configured to *not* fsync() on all Append() calls
I20260811 05:04:23.202143 2210 log.cc:824] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f: Log is configured to *not* fsync() on all Append() calls
I20260811 05:04:23.202652 2211 tablet_bootstrap.cc:654] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b: Neither blocks nor log segments found. Creating new log.
I20260811 05:04:23.203675 2211 log.cc:824] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b: Log is configured to *not* fsync() on all Append() calls
I20260811 05:04:23.204344 2209 tablet_bootstrap.cc:492] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934: No bootstrap required, opened a new log
I20260811 05:04:23.204449 2210 tablet_bootstrap.cc:492] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f: No bootstrap required, opened a new log
I20260811 05:04:23.204717 2210 ts_tablet_manager.cc:1397] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260811 05:04:23.204726 2209 ts_tablet_manager.cc:1397] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 05:04:23.206137 2211 tablet_bootstrap.cc:492] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b: No bootstrap required, opened a new log
I20260811 05:04:23.206451 2211 ts_tablet_manager.cc:1397] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b: Time spent bootstrapping tablet: real 0.007s user 0.007s sys 0.000s
I20260811 05:04:23.208461 2210 raft_consensus.cc:348] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b515c97a36043949a44501830ffb934" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37471 } } peers { permanent_uuid: "c658719ece954f0f96fc1476d029770b" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38379 } } peers { permanent_uuid: "86b9ad3830ba40adaf62fc50ec27095f" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37447 } }
I20260811 05:04:23.208921 2210 raft_consensus.cc:374] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:04:23.209010 2210 raft_consensus.cc:729] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b9ad3830ba40adaf62fc50ec27095f, State: Initialized, Role: FOLLOWER
I20260811 05:04:23.209571 2210 consensus_queue.cc:260] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b515c97a36043949a44501830ffb934" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37471 } } peers { permanent_uuid: "c658719ece954f0f96fc1476d029770b" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38379 } } peers { permanent_uuid: "86b9ad3830ba40adaf62fc50ec27095f" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37447 } }
I20260811 05:04:23.210464 2190 heartbeater.cc:503] Master 127.22.49.254:45793 was elected leader, sending a full tablet report...
I20260811 05:04:23.210018 2209 raft_consensus.cc:348] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b515c97a36043949a44501830ffb934" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37471 } } peers { permanent_uuid: "c658719ece954f0f96fc1476d029770b" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38379 } } peers { permanent_uuid: "86b9ad3830ba40adaf62fc50ec27095f" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37447 } }
I20260811 05:04:23.210598 2209 raft_consensus.cc:374] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:04:23.210685 2209 raft_consensus.cc:729] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b515c97a36043949a44501830ffb934, State: Initialized, Role: FOLLOWER
I20260811 05:04:23.210901 2210 ts_tablet_manager.cc:1428] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260811 05:04:23.211254 2209 consensus_queue.cc:260] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b515c97a36043949a44501830ffb934" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37471 } } peers { permanent_uuid: "c658719ece954f0f96fc1476d029770b" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38379 } } peers { permanent_uuid: "86b9ad3830ba40adaf62fc50ec27095f" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37447 } }
I20260811 05:04:23.211542 2211 raft_consensus.cc:348] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b515c97a36043949a44501830ffb934" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37471 } } peers { permanent_uuid: "c658719ece954f0f96fc1476d029770b" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38379 } } peers { permanent_uuid: "86b9ad3830ba40adaf62fc50ec27095f" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37447 } }
I20260811 05:04:23.211871 2211 raft_consensus.cc:374] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:04:23.211944 2211 raft_consensus.cc:729] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c658719ece954f0f96fc1476d029770b, State: Initialized, Role: FOLLOWER
I20260811 05:04:23.212508 2211 consensus_queue.cc:260] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b515c97a36043949a44501830ffb934" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37471 } } peers { permanent_uuid: "c658719ece954f0f96fc1476d029770b" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38379 } } peers { permanent_uuid: "86b9ad3830ba40adaf62fc50ec27095f" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37447 } }
I20260811 05:04:23.212684 2209 ts_tablet_manager.cc:1428] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934: Time spent starting tablet: real 0.008s user 0.004s sys 0.005s
I20260811 05:04:23.213243 1894 heartbeater.cc:503] Master 127.22.49.254:45793 was elected leader, sending a full tablet report...
I20260811 05:04:23.213498 2042 heartbeater.cc:503] Master 127.22.49.254:45793 was elected leader, sending a full tablet report...
I20260811 05:04:23.214385 2211 ts_tablet_manager.cc:1428] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260811 05:04:23.275354 2217 raft_consensus.cc:482] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:04:23.275638 2217 raft_consensus.cc:504] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b515c97a36043949a44501830ffb934" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37471 } } peers { permanent_uuid: "c658719ece954f0f96fc1476d029770b" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38379 } } peers { permanent_uuid: "86b9ad3830ba40adaf62fc50ec27095f" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37447 } }
I20260811 05:04:23.277042 2217 leader_election.cc:288] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c658719ece954f0f96fc1476d029770b (127.22.49.194:38379), 86b9ad3830ba40adaf62fc50ec27095f (127.22.49.195:37447)
I20260811 05:04:23.281987 2208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:23.277599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:58099 (local address 127.22.49.195:37447)
0811 05:04:23.277821 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:23.277825 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:23.278068 (+ 243us) server_negotiation.cc:407] Connection header received
0811 05:04:23.278349 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:23.278352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:23.278397 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:23.278525 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:04:23.278848 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.279425 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.280646 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.281317 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.281459 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:23.281514 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:23.281736 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 05:04:23.281822 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260811 05:04:23.282106 2220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:23.277459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:37447 (local address 127.22.49.193:58099)
0811 05:04:23.277899 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:23.277913 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:23.278158 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:23.278536 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:23.278539 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:23.278555 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:04:23.278726 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:23.278732 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.279545 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.279549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:23.280505 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:23.280516 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.281460 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.281464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:23.281573 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:23.281602 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 05:04:23.281697 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 05:04:23.281793 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":62,"thread_start_us":124,"threads_started":1}
I20260811 05:04:23.282833 2206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:23.277464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:53233 (local address 127.22.49.194:38379)
0811 05:04:23.277644 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:23.277649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:23.277983 (+ 334us) server_negotiation.cc:407] Connection header received
0811 05:04:23.278245 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:23.278248 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:23.278306 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:23.278452 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:04:23.278822 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.279407 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.280703 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.281339 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.281458 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:23.281514 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:23.282603 (+ 1089us) server_negotiation.cc:299] Negotiation successful
0811 05:04:23.282710 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 05:04:23.282867 2219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:23.277303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38379 (local address 127.22.49.193:53233)
0811 05:04:23.277822 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:23.277840 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 05:04:23.278070 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:04:23.278457 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:04:23.278461 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:04:23.278478 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:04:23.278657 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:23.278664 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.279530 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.279536 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:23.280526 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:04:23.280538 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.281825 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.281831 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:04:23.281930 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:23.281957 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 05:04:23.282627 (+ 670us) client_negotiation.cc:240] Negotiation successful
0811 05:04:23.282712 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"mutex_wait_us":83,"thread_start_us":190,"threads_started":1}
I20260811 05:04:23.282797 2141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a05a07ddf3343ac82dde1004128934b" candidate_uuid: "6b515c97a36043949a44501830ffb934" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b9ad3830ba40adaf62fc50ec27095f" is_pre_election: true
I20260811 05:04:23.283236 2141 raft_consensus.cc:2454] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b515c97a36043949a44501830ffb934 in term 0.
I20260811 05:04:23.283555 1992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a05a07ddf3343ac82dde1004128934b" candidate_uuid: "6b515c97a36043949a44501830ffb934" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c658719ece954f0f96fc1476d029770b" is_pre_election: true
I20260811 05:04:23.283787 1771 leader_election.cc:302] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b515c97a36043949a44501830ffb934, 86b9ad3830ba40adaf62fc50ec27095f; no voters:
I20260811 05:04:23.283893 1992 raft_consensus.cc:2454] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b515c97a36043949a44501830ffb934 in term 0.
I20260811 05:04:23.284107 2217 raft_consensus.cc:2781] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:04:23.284204 2217 raft_consensus.cc:482] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:04:23.284263 2217 raft_consensus.cc:3037] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:04:23.285441 2217 raft_consensus.cc:504] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b515c97a36043949a44501830ffb934" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37471 } } peers { permanent_uuid: "c658719ece954f0f96fc1476d029770b" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38379 } } peers { permanent_uuid: "86b9ad3830ba40adaf62fc50ec27095f" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37447 } }
I20260811 05:04:23.285841 2217 leader_election.cc:288] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [CANDIDATE]: Term 1 election: Requested vote from peers c658719ece954f0f96fc1476d029770b (127.22.49.194:38379), 86b9ad3830ba40adaf62fc50ec27095f (127.22.49.195:37447)
I20260811 05:04:23.286242 1992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a05a07ddf3343ac82dde1004128934b" candidate_uuid: "6b515c97a36043949a44501830ffb934" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c658719ece954f0f96fc1476d029770b"
I20260811 05:04:23.286255 2141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a05a07ddf3343ac82dde1004128934b" candidate_uuid: "6b515c97a36043949a44501830ffb934" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b9ad3830ba40adaf62fc50ec27095f"
I20260811 05:04:23.286405 1992 raft_consensus.cc:3037] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:04:23.286406 2141 raft_consensus.cc:3037] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:04:23.287779 1992 raft_consensus.cc:2454] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b515c97a36043949a44501830ffb934 in term 1.
I20260811 05:04:23.287735 2141 raft_consensus.cc:2454] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b515c97a36043949a44501830ffb934 in term 1.
I20260811 05:04:23.288295 1773 leader_election.cc:302] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6b515c97a36043949a44501830ffb934, 86b9ad3830ba40adaf62fc50ec27095f, c658719ece954f0f96fc1476d029770b; no voters:
I20260811 05:04:23.288584 2217 raft_consensus.cc:2781] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:04:23.288851 2217 raft_consensus.cc:686] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [term 1 LEADER]: Becoming Leader. State: Replica: 6b515c97a36043949a44501830ffb934, State: Running, Role: LEADER
I20260811 05:04:23.289273 2217 consensus_queue.cc:237] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b515c97a36043949a44501830ffb934" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37471 } } peers { permanent_uuid: "c658719ece954f0f96fc1476d029770b" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38379 } } peers { permanent_uuid: "86b9ad3830ba40adaf62fc50ec27095f" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37447 } }
I20260811 05:04:23.292810 1683 catalog_manager.cc:5495] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b515c97a36043949a44501830ffb934 (127.22.49.193). New cstate: current_term: 1 leader_uuid: "6b515c97a36043949a44501830ffb934" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b515c97a36043949a44501830ffb934" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c658719ece954f0f96fc1476d029770b" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86b9ad3830ba40adaf62fc50ec27095f" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37447 } health_report { overall_health: UNKNOWN } } }
I20260811 05:04:23.317267 2204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:23.312640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59312 (local address 127.22.49.193:37471)
0811 05:04:23.312793 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 05:04:23.312797 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:04:23.312815 (+ 18us) server_negotiation.cc:407] Connection header received
0811 05:04:23.312978 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:04:23.312982 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:04:23.313059 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:04:23.313178 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:04:23.313473 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.314260 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.315425 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:04:23.315768 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:04:23.315871 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:04:23.316248 (+ 377us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:04:23.316817 (+ 569us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:04:23.316943 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 05:04:23.317047 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 05:04:23.317117 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 05:04:23.325096 1992 raft_consensus.cc:1261] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b [term 1 FOLLOWER]: Refusing update from remote peer 6b515c97a36043949a44501830ffb934: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:04:23.325119 2141 raft_consensus.cc:1261] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f [term 1 FOLLOWER]: Refusing update from remote peer 6b515c97a36043949a44501830ffb934: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:04:23.326061 2217 consensus_queue.cc:1035] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b9ad3830ba40adaf62fc50ec27095f" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:04:23.326447 2221 consensus_queue.cc:1035] T 8a05a07ddf3343ac82dde1004128934b P 6b515c97a36043949a44501830ffb934 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c658719ece954f0f96fc1476d029770b" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:04:23.338644 2226 mvcc.cc:205] Tried to move back new op lower bound from 7317195420969463808 to 7317195420835831808. Current Snapshot: MvccSnapshot[applied={T|T < 7317195420969463808}]
I20260811 05:04:23.341064 2227 mvcc.cc:205] Tried to move back new op lower bound from 7317195420969463808 to 7317195420835831808. Current Snapshot: MvccSnapshot[applied={T|T < 7317195420969463808}]
I20260811 05:04:23.350767 1683 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:04:23.351039 1683 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:04:23.353984 1683 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 301aed1fd75e45be848675e6cb320202: Sending DeleteTablet for 3 replicas of tablet 8a05a07ddf3343ac82dde1004128934b
I20260811 05:04:23.355238 1969 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a05a07ddf3343ac82dde1004128934b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:04:23 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:50196
I20260811 05:04:23.355341 2117 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a05a07ddf3343ac82dde1004128934b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:04:23 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:41038
I20260811 05:04:23.355947 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 1752
I20260811 05:04:23.355939 2236 tablet_replica.cc:330] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f: stopping tablet replica
I20260811 05:04:23.359035 2236 raft_consensus.cc:2229] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:04:23.359521 2236 raft_consensus.cc:2258] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:04:23.360081 2235 tablet_replica.cc:330] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b: stopping tablet replica
I20260811 05:04:23.360484 2235 raft_consensus.cc:2229] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:04:23.360925 2235 raft_consensus.cc:2258] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:04:23.362282 2236 ts_tablet_manager.cc:1905] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:04:23.363157 2235 ts_tablet_manager.cc:1905] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:04:23.365172 2236 ts_tablet_manager.cc:1918] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:04:23.365320 2236 log.cc:1196] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/8a05a07ddf3343ac82dde1004128934b
I20260811 05:04:23.365665 2236 ts_tablet_manager.cc:1939] T 8a05a07ddf3343ac82dde1004128934b P 86b9ad3830ba40adaf62fc50ec27095f: Deleting consensus metadata
I20260811 05:04:23.367256 2235 ts_tablet_manager.cc:1918] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:04:23.367254 1667 catalog_manager.cc:4841] TS 86b9ad3830ba40adaf62fc50ec27095f (127.22.49.195:37447): tablet 8a05a07ddf3343ac82dde1004128934b (table test-table [id=7e16fcd3524d4ab08bf8e7c85eb1eb18]) successfully deleted
I20260811 05:04:23.367395 2235 log.cc:1196] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/8a05a07ddf3343ac82dde1004128934b
I20260811 05:04:23.367833 2235 ts_tablet_manager.cc:1939] T 8a05a07ddf3343ac82dde1004128934b P c658719ece954f0f96fc1476d029770b: Deleting consensus metadata
W20260811 05:04:23.369138 1667 connection.cc:535] client connection to 127.22.49.193:37471 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 05:04:23.369165 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 1900
W20260811 05:04:23.369398 1667 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 05:04:23.370411 1669 catalog_manager.cc:4841] TS c658719ece954f0f96fc1476d029770b (127.22.49.194:38379): tablet 8a05a07ddf3343ac82dde1004128934b (table test-table [id=7e16fcd3524d4ab08bf8e7c85eb1eb18]) successfully deleted
I20260811 05:04:23.375043 2207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:04:23.374545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:37471 (local address 127.0.0.1:59328)
0811 05:04:23.374767 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 05:04:23.374883 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:37471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260811 05:04:23.375272 1667 catalog_manager.cc:4584] TS 6b515c97a36043949a44501830ffb934 (127.22.49.193:37471): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8a05a07ddf3343ac82dde1004128934b: Network error: Client connection negotiation failed: client connection to 127.22.49.193:37471: connect: Connection refused (error 111)
I20260811 05:04:23.380712 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 2047
I20260811 05:04:23.390519 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 1649
2026-08-11T05:04:23Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2567 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:04:23 dist-test-slave-w206 krb5kdc[2240](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:04:23 dist-test-slave-w206 krb5kdc[2240](info): set up 2 sockets
Aug 11 05:04:23 dist-test-slave-w206 krb5kdc[2240](info): commencing operation
krb5kdc: starting...
W20260811 05:04:24.579494 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.005s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:04:24 dist-test-slave-w206 krb5kdc[2240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424664, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:04:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:04:24Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.22.49.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.22.49.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/rangeradmin_127.22.49.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/rangeradmin_127.22.49.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.22.49.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.22.49.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/rangerlookup_127.22.49.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/rangerlookup_127.22.49.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.49.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.22.49.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/HTTP_127.22.49.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/HTTP_127.22.49.212@KRBTEST.COM.keytab.
I20260811 05:04:24.791167 22727 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskvEfsDu/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/postgres -l logfile start
2026-08-11 05:04:27.838 UTC [2271] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 05:04:27.838 UTC [2271] LOG: listening on IPv4 address "127.22.49.212", port 49789
2026-08-11 05:04:27.843 UTC [2271] LOG: listening on Unix socket "/tmp/.s.PGSQL.49789"
2026-08-11 05:04:27.883 UTC [2274] LOG: database system was shut down at 2026-08-11 05:04:25 UTC
2026-08-11 05:04:27.888 UTC [2271] LOG: database system is ready to accept connections
I20260811 05:04:28.904699 22727 mini_postgres.cc:96] Postgres bound to 49789
2026-08-11 05:04:28.913 UTC [2284] FATAL: database "slave" does not exist
127.22.49.212:49789 - accepting connections
I20260811 05:04:28.914768 22727 mini_ranger.cc:161] Starting Ranger...
I20260811 05:04:28.934403 22727 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 05:04:29.600179 22727 mini_ranger.cc:87] Created ranger Postgres database
I20260811 05:04:29.600306 22727 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-admin
2026-08-11 05:04:29,947 [I] DB FLAVOR :POSTGRES
2026-08-11 05:04:29,947 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 05:04:29,947 [I] Checking connection..
2026-08-11 05:04:29,948 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 05:04:30,227 [I] Checking connection passed.
2026-08-11 05:04:30,227 [I] --------- Verifying version history table ---------
2026-08-11 05:04:30,228 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 05:04:30,530 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 05:04:30,531 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 05:04:30,818 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 05:04:30,818 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 05:04:30,819 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 05:04:31.101 UTC [2351] WARNING: there is no transaction in progress
2026-08-11 05:04:31,109 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 05:04:31,109 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 05:04:31,416 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 05:04:31,417 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 05:04:31,417 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 05:04:31,692 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 05:04:31,950 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-w206.c.gcp-upstream.internal','N') ;"
2026-08-11 05:04:32,208 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 05:04:32,486 [I] Table x_portal_user does not exist in database ranger
2026-08-11 05:04:32,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 05:04:32,755 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 05:04:32,755 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 05:04:33,055 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 05:04:33,325 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 05:04:33,326 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 05:04:34.547 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:34.567 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:34.588 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:34.608 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:34.627 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:34.649 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:34.717 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:34.726 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:34.743 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:34.755 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:34.768 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:34.786 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:34.798 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:34.806 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:34.815 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:34.824 UTC [2470] WARNING: there is no transaction in progress
2026-08-11 05:04:35,700 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 05:04:35,701 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 05:04:35,988 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 05:04:35,988 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 05:04:36,265 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 05:04:36,266 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 05:04:36,519 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 05:04:36,520 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 05:04:36,790 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 05:04:37,085 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-w206.c.gcp-upstream.internal';"
2026-08-11 05:04:37,392 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 05:04:37,392 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 05:04:37,652 [I] DB_PATCHES have already been applied
I20260811 05:04:37.658618 22727 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-admin:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskvEfsDu/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 05:04:37.658730 22727 mini_ranger.cc:193] Using host: 127.22.49.212
I20260811 05:04:37.663875 22727 mini_ranger.cc:227] Ranger admin URL: http://127.22.49.212:36205
Aug 11, 2026 5:04:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 5:04:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 5:04:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 5:04:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 5:04:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 5:04:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 5:04:38 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 05:04:38.900032 22727 mini_ranger.cc:160] Time spent starting Ranger: real 9.985s user 0.000s sys 0.016s
Aug 11, 2026 5:05:01 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 5:05:01 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 11, 2026 5:05:01 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 5:05:01 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 5:05:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 5:05:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 5:05:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 5:05:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 5:05:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 5:05:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 5:05:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 5:05:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 5:05:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 5:05:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 5:05:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 5:05:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 5:05:01 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 5:05:02 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 05:05:03.078262 22727 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.22.49.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.22.49.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/rangerkms_127.22.49.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/rangerkms_127.22.49.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.49.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.22.49.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.49.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/HTTP_127.22.49.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.49.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/HTTP_127.22.49.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 05:05:03 dist-test-slave-w206 krb5kdc[2240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424703, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 05:05:03.187976 22727 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 05:05:03.200933 22727 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 05:05:04.254024 22727 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 05:05:04.254134 22727 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-kms
I20260811 05:05:04.254237 22727 mini_ranger_kms.cc:227] Using postgres at 127.22.49.212:49789
2026-08-11 05:05:04,840 [I] DB FLAVOR :POSTGRES
2026-08-11 05:05:04,840 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 05:05:04,840 [I] Checking connection
2026-08-11 05:05:04,840 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 05:05:05,173 [I] connection success
2026-08-11 05:05:05,174 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 05:05:05,174 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 05:05:05,174 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 05:05:05,441 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 05:05:05,441 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 05:05:05,441 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 05:05:05,441 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:49789/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 05:05:05,744 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 05:05:06.311249 22727 mini_ranger_kms.cc:310] Created kms service
I20260811 05:05:06.549057 22727 mini_ranger_kms.cc:326] Created kudu user
I20260811 05:05:06.600354 22727 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 05:05:06 dist-test-slave-w206 krb5kdc[2240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424703, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:05:07.021284 22727 mini_ranger_kms.cc:384] Added ranger policy
I20260811 05:05:07.021449 22727 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-kms:/tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 05:05:07.021479 22727 mini_ranger_kms.cc:240] Using host: 127.22.49.212
I20260811 05:05:07.026625 22727 mini_ranger_kms.cc:276] Ranger KMS PID: 2668
I20260811 05:05:07.026804 22727 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.22.49.212:33093
Aug 11, 2026 5:05:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 5:05:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 5:05:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 5:05:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 5:05:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 5:05:08 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260811 05:05:09.401540 22727 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.214s user 0.006s sys 0.556s
I20260811 05:05:09.401705 22727 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 05:05:09.401851 22727 mini_ranger_kms.cc:401] 127.22.49.212:33093/kms/v1/keys
Aug 11 05:05:09 dist-test-slave-w206 krb5kdc[2240](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786424709, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.49.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 05:05:10 dist-test-slave-w206 krb5kdc[2240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424709, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.49.212@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
Aug 11 05:05:10 dist-test-slave-w206 krb5kdc[2240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424709, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.49.212@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
Aug 11 05:05:13 dist-test-slave-w206 krb5kdc[2240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:05:13.272142 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:44769
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:35699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:44769
--ranger_config_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.49.212:33093/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:05:13.433784 2720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:05:13.434074 2720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:05:13.434115 2720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:05:13.438329 2720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:05:13.438406 2720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:05:13.438426 2720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:05:13.438443 2720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:05:13.438459 2720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:05:13.445017 2720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:35699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/wal
--ranger_kms_url=127.22.49.212:33093/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:44769
--ranger_config_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:44769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:05:13.446166 2720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:05:13.447230 2720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:05:13.457636 2720 server_base.cc:1034] running on GCE node
W20260811 05:05:13.457701 2730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:05:13.457880 2725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:05:13.457636 2728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:05:13.458658 2720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:05:13.459947 2720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:05:13.461122 2720 hybrid_clock.cc:648] HybridClock initialized: now 1786424713461096 us; error 43 us; skew 500 ppm
Aug 11 05:05:13 dist-test-slave-w206 krb5kdc[2240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424713, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:05:13.470794 2720 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:05:13.472012 2720 webserver.cc:460] Webserver started at http://127.22.49.254:43047/ using document root <none> and password file <none>
I20260811 05:05:13.472604 2720 fs_manager.cc:359] Metadata directory not provided
I20260811 05:05:13.472666 2720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:05:13.472862 2720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:05:13 dist-test-slave-w206 krb5kdc[2240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424713, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:05:13.542711 2720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "99e3217e19f54f5a93ef79ae3b0fd00e"
format_stamp: "Formatted at 2026-08-11 05:05:13 on dist-test-slave-w206"
server_key: "51c9ba6b2b62e71c11957b62e6b92726"
server_key_iv: "bb47d2fbf4111a553816e30c4590b20e"
server_key_version: "kuduclusterkey@0"
I20260811 05:05:13.543841 2720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "99e3217e19f54f5a93ef79ae3b0fd00e"
format_stamp: "Formatted at 2026-08-11 05:05:13 on dist-test-slave-w206"
server_key: "51c9ba6b2b62e71c11957b62e6b92726"
server_key_iv: "bb47d2fbf4111a553816e30c4590b20e"
server_key_version: "kuduclusterkey@0"
I20260811 05:05:13.549672 2720 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 05:05:13.569037 2737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:05:13.570861 2720 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260811 05:05:13.571090 2720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "99e3217e19f54f5a93ef79ae3b0fd00e"
format_stamp: "Formatted at 2026-08-11 05:05:13 on dist-test-slave-w206"
server_key: "51c9ba6b2b62e71c11957b62e6b92726"
server_key_iv: "bb47d2fbf4111a553816e30c4590b20e"
server_key_version: "kuduclusterkey@0"
I20260811 05:05:13.571255 2720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:05:13.600013 2720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:05:13.603533 2720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:05:13.603804 2720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:05:13.617147 2720 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:44769
I20260811 05:05:13.617218 2796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:44769 every 8 connection(s)
I20260811 05:05:13.618389 2720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:05:13.621860 2797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:05:13.624747 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 2720
I20260811 05:05:13.624890 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:05:13.625190 22727 external_mini_cluster.cc:1428] Setting key 7be390410148cd363bbf5148cc930d0c
I20260811 05:05:13.631564 2797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e: Bootstrap starting.
I20260811 05:05:13.635111 2797 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e: Neither blocks nor log segments found. Creating new log.
I20260811 05:05:13.636445 2797 log.cc:824] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e: Log is configured to *not* fsync() on all Append() calls
Aug 11 05:05:13 dist-test-slave-w206 krb5kdc[2240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:05:13.639544 2797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e: No bootstrap required, opened a new log
I20260811 05:05:13.645366 2797 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e3217e19f54f5a93ef79ae3b0fd00e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44769 } }
I20260811 05:05:13.645803 2797 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:05:13.645915 2797 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e3217e19f54f5a93ef79ae3b0fd00e, State: Initialized, Role: FOLLOWER
I20260811 05:05:13.646083 2800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:13.626895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41300 (local address 127.22.49.254:44769)
0811 05:05:13.627562 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0811 05:05:13.627596 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0811 05:05:13.627646 (+ 50us) server_negotiation.cc:407] Connection header received
0811 05:05:13.628890 (+ 1244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:05:13.628921 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:05:13.629469 (+ 548us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:05:13.630042 (+ 573us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:05:13.631106 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:13.632702 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:13.633991 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:13.634734 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:13.634930 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:13.638557 (+ 3627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:05:13.638565 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:05:13.638582 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:05:13.638614 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:05:13.642040 (+ 3426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:05:13.642712 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:05:13.642720 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:05:13.642726 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:05:13.643066 (+ 340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:05:13.643498 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:05:13.643503 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:05:13.643504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:05:13.644024 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:05:13.644353 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0811 05:05:13.644625 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 05:05:13.645024 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":185,"threads_started":1}
I20260811 05:05:13.646481 2797 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e3217e19f54f5a93ef79ae3b0fd00e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44769 } }
I20260811 05:05:13.646696 2797 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:05:13.646795 2797 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:05:13.646955 2797 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:05:13.648919 2797 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e3217e19f54f5a93ef79ae3b0fd00e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44769 } }
I20260811 05:05:13.649328 2797 leader_election.cc:302] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99e3217e19f54f5a93ef79ae3b0fd00e; no voters:
I20260811 05:05:13.649729 2797 leader_election.cc:288] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:05:13.650046 2802 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:05:13.650624 2802 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [term 1 LEADER]: Becoming Leader. State: Replica: 99e3217e19f54f5a93ef79ae3b0fd00e, State: Running, Role: LEADER
I20260811 05:05:13.651080 2802 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e3217e19f54f5a93ef79ae3b0fd00e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44769 } }
I20260811 05:05:13.651391 2797 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:05:13.653050 2804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99e3217e19f54f5a93ef79ae3b0fd00e. Latest consensus state: current_term: 1 leader_uuid: "99e3217e19f54f5a93ef79ae3b0fd00e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e3217e19f54f5a93ef79ae3b0fd00e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44769 } } }
I20260811 05:05:13.653189 2804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [sys.catalog]: This master's current role is: LEADER
I20260811 05:05:13.653700 2803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99e3217e19f54f5a93ef79ae3b0fd00e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e3217e19f54f5a93ef79ae3b0fd00e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44769 } } }
I20260811 05:05:13.653792 2803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e [sys.catalog]: This master's current role is: LEADER
I20260811 05:05:13.655217 2812 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:05:13.655543 2797 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 05:05:13.658906 2812 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:05:13.677129 2812 catalog_manager.cc:1347] Generated new cluster ID: cd6e50cc698c4d2b975a06f7fef3a717
I20260811 05:05:13.677222 2812 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:05:13.704207 2812 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:05:13.705682 2812 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:05:13.712756 2812 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e: Generated new TSK 0
I20260811 05:05:13.713892 2812 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:05:14.699815 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.49.212:33093/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44769
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:35699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:05:14.879570 2844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:05:14.879873 2844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:05:14.879952 2844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:05:14.884409 2844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:05:14.884510 2844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:05:14.884616 2844 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:05:14.890558 2844 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:35699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.22.49.212:33093/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2844
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:05:14.891806 2844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:05:14.892904 2844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:05:14.905546 2853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:05:14.905670 2852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:05:14.905709 2855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:05:14.905982 2844 server_base.cc:1034] running on GCE node
I20260811 05:05:14.906657 2844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:05:14.907708 2844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:05:14.908926 2844 hybrid_clock.cc:648] HybridClock initialized: now 1786424714908882 us; error 57 us; skew 500 ppm
Aug 11 05:05:14 dist-test-slave-w206 krb5kdc[2240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424714, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:05:14.913551 2844 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:05:14.915031 2844 webserver.cc:460] Webserver started at http://127.22.49.193:35279/ using document root <none> and password file <none>
I20260811 05:05:14.915906 2844 fs_manager.cc:359] Metadata directory not provided
I20260811 05:05:14.916004 2844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:05:14.916427 2844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:05:14 dist-test-slave-w206 krb5kdc[2240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424714, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:05:14.934298 2844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "e53128d04034476283dd9bbeb5ce4e7e"
format_stamp: "Formatted at 2026-08-11 05:05:14 on dist-test-slave-w206"
server_key: "16e34945c818b7a5afb934d12a51b923"
server_key_iv: "84620632161cc270f2407f315d9dd317"
server_key_version: "kuduclusterkey@0"
I20260811 05:05:14.935037 2844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "e53128d04034476283dd9bbeb5ce4e7e"
format_stamp: "Formatted at 2026-08-11 05:05:14 on dist-test-slave-w206"
server_key: "16e34945c818b7a5afb934d12a51b923"
server_key_iv: "84620632161cc270f2407f315d9dd317"
server_key_version: "kuduclusterkey@0"
I20260811 05:05:14.940253 2844 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 05:05:14.977274 2862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:05:14.980589 2844 fs_manager.cc:725] Time spent opening block manager: real 0.023s user 0.004s sys 0.000s
I20260811 05:05:14.980827 2844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "e53128d04034476283dd9bbeb5ce4e7e"
format_stamp: "Formatted at 2026-08-11 05:05:14 on dist-test-slave-w206"
server_key: "16e34945c818b7a5afb934d12a51b923"
server_key_iv: "84620632161cc270f2407f315d9dd317"
server_key_version: "kuduclusterkey@0"
I20260811 05:05:14.981089 2844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:05:15.006412 2844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:05:15.010870 2844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:05:15.011348 2844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:05:15.012526 2844 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:05:15.013896 2844 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:05:15.014029 2844 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:05:15.014194 2844 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:05:15.014313 2844 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:05:15.042223 2844 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:37405
I20260811 05:05:15.043756 2844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:05:15.048416 2993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:37405 every 8 connection(s)
I20260811 05:05:15.053898 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 2844
I20260811 05:05:15.054075 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:05:15.054504 22727 external_mini_cluster.cc:1428] Setting key 3cc9636fe2329d8f85931efb007b9309
Aug 11 05:05:15 dist-test-slave-w206 krb5kdc[2240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424714, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:05:15.076261 2996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:15.051278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:36277 (local address 127.22.49.254:44769)
0811 05:05:15.051738 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0811 05:05:15.051743 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:05:15.056062 (+ 4319us) server_negotiation.cc:407] Connection header received
0811 05:05:15.061364 (+ 5302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:05:15.061369 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:05:15.061441 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:05:15.061558 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:05:15.063519 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:15.064694 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:15.066807 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:15.067229 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:15.067355 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:15.071003 (+ 3648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:05:15.071009 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:05:15.071012 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:05:15.071049 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:05:15.073285 (+ 2236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:05:15.074072 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:05:15.074077 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:05:15.074079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:05:15.074184 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:05:15.074655 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:05:15.074658 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:05:15.074660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:05:15.074932 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:05:15.075040 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 05:05:15.075888 (+ 848us) server_negotiation.cc:299] Negotiation successful
0811 05:05:15.076051 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":162,"threads_started":1}
I20260811 05:05:15.078372 2997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:15.051724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:44769 (local address 127.22.49.193:36277)
0811 05:05:15.055807 (+ 4083us) negotiation.cc:107] Waiting for socket to connect
0811 05:05:15.055919 (+ 112us) client_negotiation.cc:174] Beginning negotiation
0811 05:05:15.060969 (+ 5050us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:05:15.061847 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:05:15.061860 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:05:15.062346 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:05:15.063242 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:15.063268 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:15.064925 (+ 1657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:15.064929 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:15.066615 (+ 1686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:15.066628 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:15.067581 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:15.067586 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:15.067824 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:15.068618 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:05:15.068643 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:05:15.070693 (+ 2050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:05:15.073467 (+ 2774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:05:15.073475 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:05:15.073497 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:05:15.073927 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:05:15.074313 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:05:15.074316 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:05:15.074318 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:05:15.074529 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:05:15.075134 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:05:15.075142 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:05:15.075536 (+ 394us) client_negotiation.cc:769] Sending connection context
0811 05:05:15.076471 (+ 935us) client_negotiation.cc:240] Negotiation successful
0811 05:05:15.076960 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3426,"thread_start_us":270,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
I20260811 05:05:15.080417 2994 heartbeater.cc:347] Connected to a master server at 127.22.49.254:44769
I20260811 05:05:15.080699 2994 heartbeater.cc:464] Registering TS with master...
I20260811 05:05:15.081375 2994 heartbeater.cc:511] Master 127.22.49.254:44769 requested a full tablet report, sending...
I20260811 05:05:15.083586 2756 ts_manager.cc:194] Registered new tserver with Master: e53128d04034476283dd9bbeb5ce4e7e (127.22.49.193:37405)
I20260811 05:05:15.085589 2756 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:36277
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:05:15.107913 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.49.212:33093/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44769
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:35699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:05:15 dist-test-slave-w206 krb5kdc[2240](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786424715, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 05:05:15.320863 3000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:05:15.321401 3000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:05:15.321543 3000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:05:15.328433 3000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:05:15.328622 3000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:05:15.328769 3000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:05:15.337445 3000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:35699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.22.49.212:33093/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:05:15.339221 3000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:05:15.340703 3000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:05:15.355171 3009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:05:15.355345 3006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:05:15.355825 3007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:05:15.356854 3000 server_base.cc:1034] running on GCE node
I20260811 05:05:15.357409 3000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:05:15.358275 3000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:05:15.359606 3000 hybrid_clock.cc:648] HybridClock initialized: now 1786424715359522 us; error 111 us; skew 500 ppm
Aug 11 05:05:15 dist-test-slave-w206 krb5kdc[2240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424715, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:05:15.364070 3000 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:05:15.365572 3000 webserver.cc:460] Webserver started at http://127.22.49.194:41275/ using document root <none> and password file <none>
I20260811 05:05:15.366690 3000 fs_manager.cc:359] Metadata directory not provided
I20260811 05:05:15.366848 3000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:05:15.367357 3000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:05:15 dist-test-slave-w206 krb5kdc[2240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424715, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:05:15.389390 3000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "1040e397f0fe4c2a9b41cf8191f8df50"
format_stamp: "Formatted at 2026-08-11 05:05:15 on dist-test-slave-w206"
server_key: "f65d3f6253d1021a8c6297ac06b59507"
server_key_iv: "b1bf8ef564d820d45b397135d4829570"
server_key_version: "kuduclusterkey@0"
I20260811 05:05:15.390805 3000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "1040e397f0fe4c2a9b41cf8191f8df50"
format_stamp: "Formatted at 2026-08-11 05:05:15 on dist-test-slave-w206"
server_key: "f65d3f6253d1021a8c6297ac06b59507"
server_key_iv: "b1bf8ef564d820d45b397135d4829570"
server_key_version: "kuduclusterkey@0"
I20260811 05:05:15.397223 3000 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 05:05:15.417331 3016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:05:15.419225 3000 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 05:05:15.419451 3000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "1040e397f0fe4c2a9b41cf8191f8df50"
format_stamp: "Formatted at 2026-08-11 05:05:15 on dist-test-slave-w206"
server_key: "f65d3f6253d1021a8c6297ac06b59507"
server_key_iv: "b1bf8ef564d820d45b397135d4829570"
server_key_version: "kuduclusterkey@0"
I20260811 05:05:15.419670 3000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:05:15.458631 3000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:05:15.462864 3000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:05:15.463179 3000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:05:15.464087 3000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:05:15.465476 3000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:05:15.465586 3000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:05:15.465687 3000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:05:15.465767 3000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:05:15.492509 3000 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:33339
I20260811 05:05:15.493971 3000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:05:15.495364 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 3000
I20260811 05:05:15.495496 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:05:15.495819 22727 external_mini_cluster.cc:1428] Setting key dc77154879fb2830a648bd862c9fbf2d
I20260811 05:05:15.497290 3137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:33339 every 8 connection(s)
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
Aug 11 05:05:15 dist-test-slave-w206 krb5kdc[2240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424715, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:05:15.528391 2996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:15.503306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:46839 (local address 127.22.49.254:44769)
0811 05:05:15.503486 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 05:05:15.503491 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:05:15.508199 (+ 4708us) server_negotiation.cc:407] Connection header received
0811 05:05:15.510281 (+ 2082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:05:15.510285 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:05:15.510372 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:05:15.510452 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:05:15.512708 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:15.513745 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:15.516385 (+ 2640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:15.516799 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:15.516899 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:15.521288 (+ 4389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:05:15.521293 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:05:15.521305 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:05:15.521339 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:05:15.523595 (+ 2256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:05:15.524672 (+ 1077us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:05:15.524676 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:05:15.524678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:05:15.524841 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:05:15.525621 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:05:15.525631 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:05:15.525634 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:05:15.526117 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:05:15.526281 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 05:05:15.527805 (+ 1524us) server_negotiation.cc:299] Negotiation successful
0811 05:05:15.528095 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 05:05:15.532526 3141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:15.504067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:44769 (local address 127.22.49.194:46839)
0811 05:05:15.507918 (+ 3851us) negotiation.cc:107] Waiting for socket to connect
0811 05:05:15.508016 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0811 05:05:15.509799 (+ 1783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:05:15.511078 (+ 1279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:05:15.511090 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:05:15.511561 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:05:15.512488 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:15.512511 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:15.514032 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:15.514036 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:15.516164 (+ 2128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:15.516179 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:15.517188 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:15.517192 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:15.517493 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:15.518364 (+ 871us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:05:15.518395 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:05:15.520950 (+ 2555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:05:15.523828 (+ 2878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:05:15.523844 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:05:15.523865 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:05:15.524481 (+ 616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:05:15.525015 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:05:15.525017 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:05:15.525019 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:05:15.525390 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:05:15.526433 (+ 1043us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:05:15.526441 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:05:15.527215 (+ 774us) client_negotiation.cc:769] Sending connection context
0811 05:05:15.529550 (+ 2335us) client_negotiation.cc:240] Negotiation successful
0811 05:05:15.530295 (+ 745us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3467,"thread_start_us":280,"threads_started":1}
I20260811 05:05:15.534916 3138 heartbeater.cc:347] Connected to a master server at 127.22.49.254:44769
I20260811 05:05:15.535425 3138 heartbeater.cc:464] Registering TS with master...
I20260811 05:05:15.536631 3138 heartbeater.cc:511] Master 127.22.49.254:44769 requested a full tablet report, sending...
I20260811 05:05:15.538779 2756 ts_manager.cc:194] Registered new tserver with Master: 1040e397f0fe4c2a9b41cf8191f8df50 (127.22.49.194:33339)
I20260811 05:05:15.539636 2756 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:46839
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:05:15.547554 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.49.212:33093/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44769
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:35699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:05:15.769627 3143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:05:15.770040 3143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:05:15.770562 3143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
Aug 11 05:05:15 dist-test-slave-w206 krb5kdc[2240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424715, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
W20260811 05:05:15.776546 3143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:05:15.776728 3143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:05:15.776867 3143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:05:15.784866 3143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:35699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.22.49.212:33093/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:44769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:05:15.786564 3143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:05:15.788000 3143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:05:15.803694 3149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:05:15.804308 3151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:05:15.805413 3148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:05:15.807813 3143 server_base.cc:1034] running on GCE node
I20260811 05:05:15.808763 3143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:05:15.809613 3143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:05:15.810883 3143 hybrid_clock.cc:648] HybridClock initialized: now 1786424715810798 us; error 87 us; skew 500 ppm
Aug 11 05:05:15 dist-test-slave-w206 krb5kdc[2240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424715, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:05:15.815362 3143 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:05:15.816771 3143 webserver.cc:460] Webserver started at http://127.22.49.195:42011/ using document root <none> and password file <none>
I20260811 05:05:15.817579 3143 fs_manager.cc:359] Metadata directory not provided
I20260811 05:05:15.817720 3143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:05:15.818007 3143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:05:15 dist-test-slave-w206 krb5kdc[2240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424715, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:05:15.840531 3143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "33da83a4fc1b497e9da775dbbbc634d2"
format_stamp: "Formatted at 2026-08-11 05:05:15 on dist-test-slave-w206"
server_key: "557278444f87389517c341adf8ec5872"
server_key_iv: "69d93704ba573c371c8150c3e2146fef"
server_key_version: "kuduclusterkey@0"
I20260811 05:05:15.841483 3143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "33da83a4fc1b497e9da775dbbbc634d2"
format_stamp: "Formatted at 2026-08-11 05:05:15 on dist-test-slave-w206"
server_key: "557278444f87389517c341adf8ec5872"
server_key_iv: "69d93704ba573c371c8150c3e2146fef"
server_key_version: "kuduclusterkey@0"
I20260811 05:05:15.847334 3143 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 05:05:15.871445 3158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:05:15.873212 3143 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260811 05:05:15.873354 3143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "33da83a4fc1b497e9da775dbbbc634d2"
format_stamp: "Formatted at 2026-08-11 05:05:15 on dist-test-slave-w206"
server_key: "557278444f87389517c341adf8ec5872"
server_key_iv: "69d93704ba573c371c8150c3e2146fef"
server_key_version: "kuduclusterkey@0"
I20260811 05:05:15.873517 3143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:05:15.893523 3143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:05:15.897596 3143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:05:15.897861 3143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:05:15.898710 3143 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:05:15.900100 3143 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:05:15.900247 3143 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:05:15.900347 3143 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:05:15.900413 3143 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:05:15.918516 3143 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:38539
I20260811 05:05:15.920045 3143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:05:15.926294 3277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:38539 every 8 connection(s)
I20260811 05:05:15.929697 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 3143
I20260811 05:05:15.929864 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:05:15.930269 22727 external_mini_cluster.cc:1428] Setting key 7f58526e65ad12bf3de96b87d2c67258
Aug 11 05:05:15 dist-test-slave-w206 krb5kdc[2240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424715, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:05:15.972333 2996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:15.929985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:50017 (local address 127.22.49.254:44769)
0811 05:05:15.930120 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 05:05:15.930124 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:05:15.939793 (+ 9669us) server_negotiation.cc:407] Connection header received
0811 05:05:15.941455 (+ 1662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:05:15.941459 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:05:15.941522 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:05:15.941575 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:05:15.945744 (+ 4169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:15.946600 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:15.949463 (+ 2863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:15.950167 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:15.950346 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:15.960885 (+ 10539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:05:15.960899 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:05:15.960903 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:05:15.960963 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:05:15.964071 (+ 3108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:05:15.965601 (+ 1530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:05:15.965613 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:05:15.965615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:05:15.965789 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:05:15.966590 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:05:15.966594 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:05:15.966597 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:05:15.967043 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:05:15.967190 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 05:05:15.971931 (+ 4741us) server_negotiation.cc:299] Negotiation successful
0811 05:05:15.972133 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 05:05:15.974793 3280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:15.929498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:44769 (local address 127.22.49.195:50017)
0811 05:05:15.939551 (+ 10053us) negotiation.cc:107] Waiting for socket to connect
0811 05:05:15.939649 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0811 05:05:15.941149 (+ 1500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:05:15.942044 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:05:15.942056 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:05:15.944575 (+ 2519us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:05:15.945548 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:15.945573 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:15.946823 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:15.946827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:15.949190 (+ 2363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:15.949212 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:15.951282 (+ 2070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:15.951288 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:15.951795 (+ 507us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:15.953084 (+ 1289us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:05:15.953133 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:05:15.960465 (+ 7332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:05:15.964419 (+ 3954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:05:15.964445 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:05:15.964487 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:05:15.965336 (+ 849us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:05:15.966000 (+ 664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:05:15.966003 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:05:15.966005 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:05:15.966418 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:05:15.967421 (+ 1003us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:05:15.967431 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:05:15.971565 (+ 4134us) client_negotiation.cc:769] Sending connection context
0811 05:05:15.972882 (+ 1317us) client_negotiation.cc:240] Negotiation successful
0811 05:05:15.973354 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9686,"thread_start_us":497,"threads_started":1}
I20260811 05:05:15.976891 3278 heartbeater.cc:347] Connected to a master server at 127.22.49.254:44769
I20260811 05:05:15.977190 3278 heartbeater.cc:464] Registering TS with master...
I20260811 05:05:15.977957 3278 heartbeater.cc:511] Master 127.22.49.254:44769 requested a full tablet report, sending...
I20260811 05:05:15.979809 2756 ts_manager.cc:194] Registered new tserver with Master: 33da83a4fc1b497e9da775dbbbc634d2 (127.22.49.195:38539)
I20260811 05:05:15.980834 2756 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:50017
I20260811 05:05:15.984357 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:05:16.000825 2996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:15.989529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59650 (local address 127.22.49.254:44769)
0811 05:05:15.989664 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 05:05:15.989668 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:05:15.990497 (+ 829us) server_negotiation.cc:407] Connection header received
0811 05:05:15.990725 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:05:15.990729 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:05:15.990783 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:05:15.990857 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:05:15.992155 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:15.993000 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:15.994284 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:15.994637 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:15.994722 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:15.996834 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:05:15.996838 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:05:15.996841 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:05:15.996872 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:05:15.998673 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:05:15.999268 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:05:15.999272 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:05:15.999274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:05:15.999376 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:05:15.999709 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:05:15.999713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:05:15.999714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:05:15.999993 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:05:16.000132 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 05:05:16.000508 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 05:05:16.000650 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 05:05:16.005692 2756 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59650:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:05:16.010932 2756 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:05:16.042183 3296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:16.026535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:38539 (local address 127.0.0.1:56194)
0811 05:05:16.032662 (+ 6127us) negotiation.cc:107] Waiting for socket to connect
0811 05:05:16.032727 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 05:05:16.032874 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:05:16.035379 (+ 2505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:05:16.035386 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:05:16.035414 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:05:16.035566 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:16.035574 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.037297 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.037301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:16.039876 (+ 2575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:16.039886 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.041582 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.041585 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:16.041701 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:16.041737 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 05:05:16.041842 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 05:05:16.041990 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5924,"thread_start_us":267,"threads_started":1}
I20260811 05:05:16.043234 3293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:16.027670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56194 (local address 127.22.49.195:38539)
0811 05:05:16.032311 (+ 4641us) server_negotiation.cc:206] Beginning negotiation
0811 05:05:16.032326 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 05:05:16.033068 (+ 742us) server_negotiation.cc:407] Connection header received
0811 05:05:16.033158 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:05:16.033163 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:05:16.033434 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:05:16.033604 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:05:16.035721 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.037127 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.040175 (+ 3048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.041216 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.041330 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:16.041513 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 05:05:16.042899 (+ 1386us) server_negotiation.cc:299] Negotiation successful
0811 05:05:16.043044 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4512,"thread_start_us":190,"threads_started":1}
I20260811 05:05:16.046370 3294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:16.029696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:33339 (local address 127.0.0.1:56364)
0811 05:05:16.034077 (+ 4381us) negotiation.cc:107] Waiting for socket to connect
0811 05:05:16.034094 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:05:16.034194 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:05:16.040326 (+ 6132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:05:16.040330 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:05:16.040352 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:05:16.040479 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:16.040486 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.041916 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.041919 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:16.044390 (+ 2471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:16.044402 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.045802 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.045805 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:16.045982 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:16.046070 (+ 88us) client_negotiation.cc:769] Sending connection context
0811 05:05:16.046146 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 05:05:16.046223 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4123,"mutex_wait_us":1275,"thread_start_us":208,"threads_started":1}
I20260811 05:05:16.048293 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:16.029839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56364 (local address 127.22.49.194:33339)
0811 05:05:16.039446 (+ 9607us) server_negotiation.cc:206] Beginning negotiation
0811 05:05:16.039466 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 05:05:16.039493 (+ 27us) server_negotiation.cc:407] Connection header received
0811 05:05:16.039582 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:05:16.039588 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:05:16.039839 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:05:16.040119 (+ 280us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:05:16.040629 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.041753 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.044549 (+ 2796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.045481 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.045590 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:16.045734 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 05:05:16.047977 (+ 2243us) server_negotiation.cc:299] Negotiation successful
0811 05:05:16.048094 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9500,"thread_start_us":258,"threads_started":1}
I20260811 05:05:16.048239 3209 tablet_service.cc:1467] Processing CreateTablet for tablet 9113b434b5744a569742b88f48dea5ec (DEFAULT_TABLE table=test-table [id=67db44c9e8864fe2b638dd644a4b90b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:05:16.049952 3291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:16.030565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:37405 (local address 127.0.0.1:58384)
0811 05:05:16.039209 (+ 8644us) negotiation.cc:107] Waiting for socket to connect
0811 05:05:16.039226 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:05:16.039373 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:05:16.040254 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:05:16.040257 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:05:16.040275 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:05:16.040460 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:16.040469 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.041931 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.041934 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:16.043236 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:16.043249 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.049398 (+ 6149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.049403 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:16.049579 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:16.049606 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 05:05:16.049688 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 05:05:16.049780 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8555,"thread_start_us":210,"threads_started":1}
I20260811 05:05:16.050549 3297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:16.030705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58384 (local address 127.22.49.193:37405)
0811 05:05:16.039239 (+ 8534us) server_negotiation.cc:206] Beginning negotiation
0811 05:05:16.039248 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:05:16.039489 (+ 241us) server_negotiation.cc:407] Connection header received
0811 05:05:16.039583 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:05:16.039589 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:05:16.039830 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:05:16.040041 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:05:16.040607 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.041769 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.046642 (+ 4873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.047603 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.047735 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:16.047889 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 05:05:16.050208 (+ 2319us) server_negotiation.cc:299] Negotiation successful
0811 05:05:16.050337 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8389,"thread_start_us":168,"threads_started":1}
I20260811 05:05:16.051426 3209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9113b434b5744a569742b88f48dea5ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:05:16.054258 3068 tablet_service.cc:1467] Processing CreateTablet for tablet 9113b434b5744a569742b88f48dea5ec (DEFAULT_TABLE table=test-table [id=67db44c9e8864fe2b638dd644a4b90b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:05:16.054280 2915 tablet_service.cc:1467] Processing CreateTablet for tablet 9113b434b5744a569742b88f48dea5ec (DEFAULT_TABLE table=test-table [id=67db44c9e8864fe2b638dd644a4b90b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:05:16.055492 3068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9113b434b5744a569742b88f48dea5ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:05:16.055507 2915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9113b434b5744a569742b88f48dea5ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:05:16.064061 3298 tablet_bootstrap.cc:492] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2: Bootstrap starting.
I20260811 05:05:16.065448 3300 tablet_bootstrap.cc:492] T 9113b434b5744a569742b88f48dea5ec P e53128d04034476283dd9bbeb5ce4e7e: Bootstrap starting.
I20260811 05:05:16.068070 3300 tablet_bootstrap.cc:654] T 9113b434b5744a569742b88f48dea5ec P e53128d04034476283dd9bbeb5ce4e7e: Neither blocks nor log segments found. Creating new log.
I20260811 05:05:16.068873 3298 tablet_bootstrap.cc:654] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2: Neither blocks nor log segments found. Creating new log.
I20260811 05:05:16.070062 3298 log.cc:824] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2: Log is configured to *not* fsync() on all Append() calls
I20260811 05:05:16.072983 3298 tablet_bootstrap.cc:492] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2: No bootstrap required, opened a new log
I20260811 05:05:16.073230 3298 ts_tablet_manager.cc:1397] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.005s
I20260811 05:05:16.074148 3300 log.cc:824] T 9113b434b5744a569742b88f48dea5ec P e53128d04034476283dd9bbeb5ce4e7e: Log is configured to *not* fsync() on all Append() calls
I20260811 05:05:16.075577 3301 tablet_bootstrap.cc:492] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50: Bootstrap starting.
I20260811 05:05:16.078545 3301 tablet_bootstrap.cc:654] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50: Neither blocks nor log segments found. Creating new log.
I20260811 05:05:16.080163 3301 log.cc:824] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50: Log is configured to *not* fsync() on all Append() calls
I20260811 05:05:16.082350 3298 raft_consensus.cc:348] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33da83a4fc1b497e9da775dbbbc634d2" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38539 } } peers { permanent_uuid: "1040e397f0fe4c2a9b41cf8191f8df50" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 33339 } } peers { permanent_uuid: "e53128d04034476283dd9bbeb5ce4e7e" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37405 } }
I20260811 05:05:16.082724 3298 raft_consensus.cc:374] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:05:16.082793 3298 raft_consensus.cc:729] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33da83a4fc1b497e9da775dbbbc634d2, State: Initialized, Role: FOLLOWER
I20260811 05:05:16.082801 3301 tablet_bootstrap.cc:492] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50: No bootstrap required, opened a new log
I20260811 05:05:16.083055 3301 ts_tablet_manager.cc:1397] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260811 05:05:16.083451 3298 consensus_queue.cc:260] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33da83a4fc1b497e9da775dbbbc634d2" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38539 } } peers { permanent_uuid: "1040e397f0fe4c2a9b41cf8191f8df50" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 33339 } } peers { permanent_uuid: "e53128d04034476283dd9bbeb5ce4e7e" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37405 } }
I20260811 05:05:16.085121 3298 ts_tablet_manager.cc:1428] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2: Time spent starting tablet: real 0.012s user 0.008s sys 0.003s
I20260811 05:05:16.085631 3278 heartbeater.cc:503] Master 127.22.49.254:44769 was elected leader, sending a full tablet report...
I20260811 05:05:16.088943 3301 raft_consensus.cc:348] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33da83a4fc1b497e9da775dbbbc634d2" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38539 } } peers { permanent_uuid: "1040e397f0fe4c2a9b41cf8191f8df50" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 33339 } } peers { permanent_uuid: "e53128d04034476283dd9bbeb5ce4e7e" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37405 } }
I20260811 05:05:16.089331 3301 raft_consensus.cc:374] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:05:16.089425 3301 raft_consensus.cc:729] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1040e397f0fe4c2a9b41cf8191f8df50, State: Initialized, Role: FOLLOWER
I20260811 05:05:16.089637 2994 heartbeater.cc:503] Master 127.22.49.254:44769 was elected leader, sending a full tablet report...
I20260811 05:05:16.090123 3301 consensus_queue.cc:260] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33da83a4fc1b497e9da775dbbbc634d2" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38539 } } peers { permanent_uuid: "1040e397f0fe4c2a9b41cf8191f8df50" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 33339 } } peers { permanent_uuid: "e53128d04034476283dd9bbeb5ce4e7e" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37405 } }
I20260811 05:05:16.091434 3301 ts_tablet_manager.cc:1428] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260811 05:05:16.091831 3138 heartbeater.cc:503] Master 127.22.49.254:44769 was elected leader, sending a full tablet report...
I20260811 05:05:16.097544 3300 tablet_bootstrap.cc:492] T 9113b434b5744a569742b88f48dea5ec P e53128d04034476283dd9bbeb5ce4e7e: No bootstrap required, opened a new log
I20260811 05:05:16.097810 3300 ts_tablet_manager.cc:1397] T 9113b434b5744a569742b88f48dea5ec P e53128d04034476283dd9bbeb5ce4e7e: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.000s
I20260811 05:05:16.104766 3300 raft_consensus.cc:348] T 9113b434b5744a569742b88f48dea5ec P e53128d04034476283dd9bbeb5ce4e7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33da83a4fc1b497e9da775dbbbc634d2" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38539 } } peers { permanent_uuid: "1040e397f0fe4c2a9b41cf8191f8df50" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 33339 } } peers { permanent_uuid: "e53128d04034476283dd9bbeb5ce4e7e" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37405 } }
I20260811 05:05:16.105166 3300 raft_consensus.cc:374] T 9113b434b5744a569742b88f48dea5ec P e53128d04034476283dd9bbeb5ce4e7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:05:16.105233 3300 raft_consensus.cc:729] T 9113b434b5744a569742b88f48dea5ec P e53128d04034476283dd9bbeb5ce4e7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e53128d04034476283dd9bbeb5ce4e7e, State: Initialized, Role: FOLLOWER
I20260811 05:05:16.105929 3300 consensus_queue.cc:260] T 9113b434b5744a569742b88f48dea5ec P e53128d04034476283dd9bbeb5ce4e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33da83a4fc1b497e9da775dbbbc634d2" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38539 } } peers { permanent_uuid: "1040e397f0fe4c2a9b41cf8191f8df50" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 33339 } } peers { permanent_uuid: "e53128d04034476283dd9bbeb5ce4e7e" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37405 } }
I20260811 05:05:16.107235 3300 ts_tablet_manager.cc:1428] T 9113b434b5744a569742b88f48dea5ec P e53128d04034476283dd9bbeb5ce4e7e: Time spent starting tablet: real 0.009s user 0.011s sys 0.000s
W20260811 05:05:16.177657 3279 tablet.cc:2369] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 05:05:16 dist-test-slave-w206 krb5kdc[2240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424715, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
W20260811 05:05:16.256385 3139 tablet.cc:2369] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:05:16.300733 2995 tablet.cc:2369] T 9113b434b5744a569742b88f48dea5ec P e53128d04034476283dd9bbeb5ce4e7e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:05:16.311820 3307 raft_consensus.cc:482] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:05:16.312180 3307 raft_consensus.cc:504] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33da83a4fc1b497e9da775dbbbc634d2" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38539 } } peers { permanent_uuid: "1040e397f0fe4c2a9b41cf8191f8df50" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 33339 } } peers { permanent_uuid: "e53128d04034476283dd9bbeb5ce4e7e" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37405 } }
I20260811 05:05:16.313645 3307 leader_election.cc:288] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33da83a4fc1b497e9da775dbbbc634d2 (127.22.49.195:38539), e53128d04034476283dd9bbeb5ce4e7e (127.22.49.193:37405)
I20260811 05:05:16.321914 3293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:16.314861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:55797 (local address 127.22.49.195:38539)
0811 05:05:16.315050 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 05:05:16.315056 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:05:16.316951 (+ 1895us) server_negotiation.cc:407] Connection header received
0811 05:05:16.317174 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:05:16.317178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:05:16.317227 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:05:16.317289 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:05:16.317718 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.318536 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.320527 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.321172 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.321284 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:16.321338 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 05:05:16.321689 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 05:05:16.321771 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 05:05:16.322649 3312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:16.313830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:38539 (local address 127.22.49.194:55797)
0811 05:05:16.316843 (+ 3013us) negotiation.cc:107] Waiting for socket to connect
0811 05:05:16.316859 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:05:16.317044 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:05:16.317437 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:05:16.317440 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:05:16.317457 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:05:16.317597 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:16.317603 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.318726 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.318729 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:16.320373 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:16.320387 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.321451 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.321455 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:16.321554 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:16.321577 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 05:05:16.322385 (+ 808us) client_negotiation.cc:240] Negotiation successful
0811 05:05:16.322481 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2922,"mutex_wait_us":1,"thread_start_us":142,"threads_started":1}
I20260811 05:05:16.323577 3231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9113b434b5744a569742b88f48dea5ec" candidate_uuid: "1040e397f0fe4c2a9b41cf8191f8df50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33da83a4fc1b497e9da775dbbbc634d2" is_pre_election: true
I20260811 05:05:16.323982 3231 raft_consensus.cc:2454] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1040e397f0fe4c2a9b41cf8191f8df50 in term 0.
I20260811 05:05:16.324656 3019 leader_election.cc:302] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1040e397f0fe4c2a9b41cf8191f8df50, 33da83a4fc1b497e9da775dbbbc634d2; no voters:
I20260811 05:05:16.325043 3307 raft_consensus.cc:2781] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:05:16.325140 3307 raft_consensus.cc:482] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:05:16.325193 3307 raft_consensus.cc:3037] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:05:16.326859 3307 raft_consensus.cc:504] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33da83a4fc1b497e9da775dbbbc634d2" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38539 } } peers { permanent_uuid: "1040e397f0fe4c2a9b41cf8191f8df50" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 33339 } } peers { permanent_uuid: "e53128d04034476283dd9bbeb5ce4e7e" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37405 } }
I20260811 05:05:16.327293 3307 leader_election.cc:288] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [CANDIDATE]: Term 1 election: Requested vote from peers 33da83a4fc1b497e9da775dbbbc634d2 (127.22.49.195:38539), e53128d04034476283dd9bbeb5ce4e7e (127.22.49.193:37405)
I20260811 05:05:16.327842 3231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9113b434b5744a569742b88f48dea5ec" candidate_uuid: "1040e397f0fe4c2a9b41cf8191f8df50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33da83a4fc1b497e9da775dbbbc634d2"
I20260811 05:05:16.327996 3231 raft_consensus.cc:3037] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:05:16.329366 3297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:16.315068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:37319 (local address 127.22.49.193:37405)
0811 05:05:16.315194 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 05:05:16.315199 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:05:16.320121 (+ 4922us) server_negotiation.cc:407] Connection header received
0811 05:05:16.320318 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:05:16.320321 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:05:16.320376 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:05:16.320423 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:05:16.321404 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.322182 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.327433 (+ 5251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.328056 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.328162 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:16.328215 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 05:05:16.329144 (+ 929us) server_negotiation.cc:299] Negotiation successful
0811 05:05:16.329239 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 05:05:16.330018 3311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:16.314302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:37405 (local address 127.22.49.194:37319)
0811 05:05:16.320008 (+ 5706us) negotiation.cc:107] Waiting for socket to connect
0811 05:05:16.320025 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:05:16.320200 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:05:16.320560 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:05:16.320563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:05:16.320579 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:05:16.320763 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:16.320769 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.322336 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.322339 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:16.327252 (+ 4913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:05:16.327264 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.328318 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.328321 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:05:16.328500 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:16.328998 (+ 498us) client_negotiation.cc:769] Sending connection context
0811 05:05:16.329704 (+ 706us) client_negotiation.cc:240] Negotiation successful
0811 05:05:16.329792 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5608,"thread_start_us":146,"threads_started":1}
I20260811 05:05:16.330241 3231 raft_consensus.cc:2454] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1040e397f0fe4c2a9b41cf8191f8df50 in term 1.
I20260811 05:05:16.330608 3019 leader_election.cc:302] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1040e397f0fe4c2a9b41cf8191f8df50, 33da83a4fc1b497e9da775dbbbc634d2; no voters:
I20260811 05:05:16.330807 3307 raft_consensus.cc:2781] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:05:16.331084 3307 raft_consensus.cc:686] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [term 1 LEADER]: Becoming Leader. State: Replica: 1040e397f0fe4c2a9b41cf8191f8df50, State: Running, Role: LEADER
I20260811 05:05:16.331480 2942 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9113b434b5744a569742b88f48dea5ec" candidate_uuid: "1040e397f0fe4c2a9b41cf8191f8df50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e53128d04034476283dd9bbeb5ce4e7e" is_pre_election: true
I20260811 05:05:16.331480 3307 consensus_queue.cc:237] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33da83a4fc1b497e9da775dbbbc634d2" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38539 } } peers { permanent_uuid: "1040e397f0fe4c2a9b41cf8191f8df50" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 33339 } } peers { permanent_uuid: "e53128d04034476283dd9bbeb5ce4e7e" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37405 } }
I20260811 05:05:16.331787 2942 raft_consensus.cc:2454] T 9113b434b5744a569742b88f48dea5ec P e53128d04034476283dd9bbeb5ce4e7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1040e397f0fe4c2a9b41cf8191f8df50 in term 0.
I20260811 05:05:16.332594 2941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9113b434b5744a569742b88f48dea5ec" candidate_uuid: "1040e397f0fe4c2a9b41cf8191f8df50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e53128d04034476283dd9bbeb5ce4e7e"
I20260811 05:05:16.332710 2941 raft_consensus.cc:3037] T 9113b434b5744a569742b88f48dea5ec P e53128d04034476283dd9bbeb5ce4e7e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:05:16.334291 2941 raft_consensus.cc:2454] T 9113b434b5744a569742b88f48dea5ec P e53128d04034476283dd9bbeb5ce4e7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1040e397f0fe4c2a9b41cf8191f8df50 in term 1.
I20260811 05:05:16.335376 2756 catalog_manager.cc:5495] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1040e397f0fe4c2a9b41cf8191f8df50 (127.22.49.194). New cstate: current_term: 1 leader_uuid: "1040e397f0fe4c2a9b41cf8191f8df50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33da83a4fc1b497e9da775dbbbc634d2" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1040e397f0fe4c2a9b41cf8191f8df50" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 33339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e53128d04034476283dd9bbeb5ce4e7e" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37405 } health_report { overall_health: UNKNOWN } } }
I20260811 05:05:16.405874 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:16.400629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56372 (local address 127.22.49.194:33339)
0811 05:05:16.400785 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 05:05:16.400789 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:05:16.400803 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:05:16.400990 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:05:16.400992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:05:16.401049 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:05:16.401174 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:05:16.401416 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.402145 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.403538 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:05:16.403910 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:05:16.404020 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:05:16.404497 (+ 477us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:05:16.405079 (+ 582us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:05:16.405206 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 05:05:16.405659 (+ 453us) server_negotiation.cc:299] Negotiation successful
0811 05:05:16.405725 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 05:05:16.414177 2941 raft_consensus.cc:1261] T 9113b434b5744a569742b88f48dea5ec P e53128d04034476283dd9bbeb5ce4e7e [term 1 FOLLOWER]: Refusing update from remote peer 1040e397f0fe4c2a9b41cf8191f8df50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:05:16.414194 3231 raft_consensus.cc:1261] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2 [term 1 FOLLOWER]: Refusing update from remote peer 1040e397f0fe4c2a9b41cf8191f8df50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:05:16.415129 3314 consensus_queue.cc:1035] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33da83a4fc1b497e9da775dbbbc634d2" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:05:16.415337 3307 consensus_queue.cc:1035] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e53128d04034476283dd9bbeb5ce4e7e" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 37405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:05:16.437666 3317 mvcc.cc:205] Tried to move back new op lower bound from 7317195638422093824 to 7317195638097551360. Current Snapshot: MvccSnapshot[applied={T|T < 7317195638422093824}]
I20260811 05:05:16.450495 3320 mvcc.cc:205] Tried to move back new op lower bound from 7317195638422093824 to 7317195638097551360. Current Snapshot: MvccSnapshot[applied={T|T < 7317195638422093824}]
I20260811 05:05:16.451095 3318 mvcc.cc:205] Tried to move back new op lower bound from 7317195638422093824 to 7317195638097551360. Current Snapshot: MvccSnapshot[applied={T|T < 7317195638422093824}]
I20260811 05:05:16.457722 2756 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:05:16.457974 2756 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:05:16.461382 2756 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 99e3217e19f54f5a93ef79ae3b0fd00e: Sending DeleteTablet for 3 replicas of tablet 9113b434b5744a569742b88f48dea5ec
I20260811 05:05:16.462787 3068 tablet_service.cc:1514] Processing DeleteTablet for tablet 9113b434b5744a569742b88f48dea5ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:05:16 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:56364
I20260811 05:05:16.463569 2915 tablet_service.cc:1514] Processing DeleteTablet for tablet 9113b434b5744a569742b88f48dea5ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:05:16 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:58384
I20260811 05:05:16.464792 3209 tablet_service.cc:1514] Processing DeleteTablet for tablet 9113b434b5744a569742b88f48dea5ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:05:16 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:56194
I20260811 05:05:16.465852 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 2844
I20260811 05:05:16.475354 3326 tablet_replica.cc:330] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50: stopping tablet replica
I20260811 05:05:16.475927 3326 raft_consensus.cc:2229] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:05:16.478080 3326 raft_consensus.cc:2258] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:05:16.480767 3328 tablet_replica.cc:330] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2: stopping tablet replica
I20260811 05:05:16.483381 3328 raft_consensus.cc:2229] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:05:16.484023 3326 ts_tablet_manager.cc:1905] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:05:16.484539 3328 raft_consensus.cc:2258] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:05:16.487998 3326 ts_tablet_manager.cc:1918] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:05:16.492146 3328 ts_tablet_manager.cc:1905] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 05:05:16.495671 2738 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:37405 (error 108)
I20260811 05:05:16.496721 3326 log.cc:1196] T 9113b434b5744a569742b88f48dea5ec P 1040e397f0fe4c2a9b41cf8191f8df50: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/9113b434b5744a569742b88f48dea5ec
I20260811 05:05:16.497048 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 3000
I20260811 05:05:16.499718 3328 ts_tablet_manager.cc:1918] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:05:16.499871 3328 log.cc:1196] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/9113b434b5744a569742b88f48dea5ec
I20260811 05:05:16.500329 3328 ts_tablet_manager.cc:1939] T 9113b434b5744a569742b88f48dea5ec P 33da83a4fc1b497e9da775dbbbc634d2: Deleting consensus metadata
I20260811 05:05:16.503474 3291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:16.502837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:37405 (local address 127.0.0.1:58400)
0811 05:05:16.503245 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0811 05:05:16.503348 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:37405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294}
I20260811 05:05:16.503706 2740 catalog_manager.cc:4841] TS 33da83a4fc1b497e9da775dbbbc634d2 (127.22.49.195:38539): tablet 9113b434b5744a569742b88f48dea5ec (table test-table [id=67db44c9e8864fe2b638dd644a4b90b5]) successfully deleted
W20260811 05:05:16.504524 2738 catalog_manager.cc:4584] TS e53128d04034476283dd9bbeb5ce4e7e (127.22.49.193:37405): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9113b434b5744a569742b88f48dea5ec: Network error: Client connection negotiation failed: client connection to 127.22.49.193:37405: connect: Connection refused (error 111)
I20260811 05:05:16.509200 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 3143
I20260811 05:05:16.512499 3291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:05:16.511952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:33339 (local address 127.0.0.1:56382)
0811 05:05:16.512269 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 05:05:16.512359 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.194:33339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176}
I20260811 05:05:16.521095 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 2720
I20260811 05:05:16.529584 22727 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 05:05:16.875434 22727 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 05:05:16.875579 22727 mini_ranger.cc:66] Stopping Ranger...
I20260811 05:05:17.221928 22727 mini_ranger.cc:68] Stopped Ranger
2026-08-11 05:05:17.222 UTC [2271] LOG: received smart shutdown request
2026-08-11 05:05:17.227 UTC [2271] LOG: background worker "logical replication launcher" (PID 2281) exited with exit code 1
2026-08-11 05:05:17.227 UTC [2275] LOG: shutting down
2026-08-11 05:05:17.404 UTC [2271] LOG: database system is shut down
2026-08-11T05:05:17Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (54150 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:05:17 dist-test-slave-w206 krb5kdc[3340](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:05:17 dist-test-slave-w206 krb5kdc[3340](info): set up 2 sockets
Aug 11 05:05:17 dist-test-slave-w206 krb5kdc[3340](info): commencing operation
krb5kdc: starting...
W20260811 05:05:18.665374 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:05:18 dist-test-slave-w206 krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:05:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:05:18Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.22.49.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.22.49.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/rangeradmin_127.22.49.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/rangeradmin_127.22.49.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.22.49.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.22.49.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/rangerlookup_127.22.49.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/rangerlookup_127.22.49.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.49.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.22.49.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/HTTP_127.22.49.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/HTTP_127.22.49.212@KRBTEST.COM.keytab.
I20260811 05:05:18.878660 22727 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskvEfsDu/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/postgres -l logfile start
2026-08-11 05:05:21.606 UTC [3373] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 05:05:21.606 UTC [3373] LOG: listening on IPv4 address "127.22.49.212", port 38677
2026-08-11 05:05:21.610 UTC [3373] LOG: listening on Unix socket "/tmp/.s.PGSQL.38677"
2026-08-11 05:05:21.634 UTC [3376] LOG: database system was shut down at 2026-08-11 05:05:19 UTC
2026-08-11 05:05:21.638 UTC [3373] LOG: database system is ready to accept connections
I20260811 05:05:22.646534 22727 mini_postgres.cc:96] Postgres bound to 38677
2026-08-11 05:05:22.654 UTC [3384] FATAL: database "slave" does not exist
127.22.49.212:38677 - accepting connections
I20260811 05:05:22.655208 22727 mini_ranger.cc:161] Starting Ranger...
I20260811 05:05:22.673000 22727 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 05:05:23.207995 22727 mini_ranger.cc:87] Created ranger Postgres database
I20260811 05:05:23.208101 22727 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-admin
2026-08-11 05:05:23,511 [I] DB FLAVOR :POSTGRES
2026-08-11 05:05:23,512 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 05:05:23,512 [I] Checking connection..
2026-08-11 05:05:23,512 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 05:05:23,782 [I] Checking connection passed.
2026-08-11 05:05:23,782 [I] --------- Verifying version history table ---------
2026-08-11 05:05:23,782 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 05:05:24,031 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 05:05:24,032 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 05:05:24,285 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 05:05:24,286 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 05:05:24,286 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 05:05:24.532 UTC [3451] WARNING: there is no transaction in progress
2026-08-11 05:05:24,540 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 05:05:24,540 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 05:05:24,808 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 05:05:24,808 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 05:05:24,809 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 05:05:25,063 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 05:05:25,343 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-w206.c.gcp-upstream.internal','N') ;"
2026-08-11 05:05:25,582 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 05:05:25,828 [I] Table x_portal_user does not exist in database ranger
2026-08-11 05:05:25,828 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 05:05:26,112 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 05:05:26,113 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 05:05:26,379 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 05:05:26,644 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 05:05:26,644 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 05:05:27.695 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:27.713 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:27.733 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:27.751 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:27.771 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:27.790 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:27.858 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:27.866 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:27.882 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:27.894 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:27.906 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:27.923 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:27.935 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:27.942 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:27.950 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:27.959 UTC [3567] WARNING: there is no transaction in progress
2026-08-11 05:05:28,738 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 05:05:28,739 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 05:05:29,021 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 05:05:29,022 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 05:05:29,285 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 05:05:29,285 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 05:05:29,536 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 05:05:29,536 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 05:05:29,797 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 05:05:30,047 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-w206.c.gcp-upstream.internal';"
2026-08-11 05:05:30,304 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 05:05:30,305 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 05:05:30,578 [I] DB_PATCHES have already been applied
I20260811 05:05:30.584888 22727 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-admin:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskvEfsDu/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 05:05:30.584973 22727 mini_ranger.cc:193] Using host: 127.22.49.212
I20260811 05:05:30.589646 22727 mini_ranger.cc:227] Ranger admin URL: http://127.22.49.212:40413
Aug 11, 2026 5:05:30 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 5:05:30 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 5:05:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 5:05:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 5:05:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 5:05:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 5:05:31 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 05:05:31.776592 22727 mini_ranger.cc:160] Time spent starting Ranger: real 9.121s user 0.001s sys 0.012s
Aug 11, 2026 5:05:53 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 5:05:53 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 11, 2026 5:05:53 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 5:05:53 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 5:05:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 5:05:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 5:05:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 5:05:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 5:05:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 5:05:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 5:05:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 5:05:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 5:05:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 5:05:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 5:05:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 5:05:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 5:05:53 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 5:05:54 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 05:05:55.068920 22727 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.22.49.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.22.49.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/rangerkms_127.22.49.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.22.49.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/rangerkms_127.22.49.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.49.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.22.49.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.49.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/HTTP_127.22.49.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.49.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/HTTP_127.22.49.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 05:05:55 dist-test-slave-w206 krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424755, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 05:05:55.177280 22727 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 05:05:55.190485 22727 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 05:05:56.192780 22727 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 05:05:56.192874 22727 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-kms
I20260811 05:05:56.192890 22727 mini_ranger_kms.cc:227] Using postgres at 127.22.49.212:38677
2026-08-11 05:05:56,387 [I] DB FLAVOR :POSTGRES
2026-08-11 05:05:56,387 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 05:05:56,387 [I] Checking connection
2026-08-11 05:05:56,387 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 05:05:56,643 [I] connection success
2026-08-11 05:05:56,643 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 05:05:56,643 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 05:05:56,644 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 05:05:56,893 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 05:05:56,893 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 05:05:56,894 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 05:05:56,894 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.49.212:38677/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 05:05:57,180 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 05:05:57.721274 22727 mini_ranger_kms.cc:310] Created kms service
I20260811 05:05:57.956087 22727 mini_ranger_kms.cc:326] Created kudu user
I20260811 05:05:58.000797 22727 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 05:05:58 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424755, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:05:58.459321 22727 mini_ranger_kms.cc:384] Added ranger policy
I20260811 05:05:58.459482 22727 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-kms:/tmp/dist-test-taskvEfsDu/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskvEfsDu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 05:05:58.459506 22727 mini_ranger_kms.cc:240] Using host: 127.22.49.212
I20260811 05:05:58.464821 22727 mini_ranger_kms.cc:276] Ranger KMS PID: 3759
I20260811 05:05:58.464931 22727 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.22.49.212:60401
Aug 11, 2026 5:05:59 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 5:05:59 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 5:05:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 5:05:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 5:05:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 5:05:59 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 05:06:00 dist-test-slave-w206 krb5kdc[3340](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786424760, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.49.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:01.020565 22727 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.843s user 0.017s sys 0.159s
I20260811 05:06:01.020696 22727 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 05:06:01.020768 22727 mini_ranger_kms.cc:401] 127.22.49.212:60401/kms/v1/keys
Aug 11 05:06:01 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424760, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.49.212@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
Aug 11 05:06:01 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424760, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.49.212@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
Aug 11 05:06:03 dist-test-slave-w206 krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:06:03.998618 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:43121
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:44761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:43121
--ranger_config_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.49.212:60401/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:04.112100 3811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:04.112390 3811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:04.112430 3811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:04.116653 3811 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:06:04.116719 3811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:04.116737 3811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:04.116755 3811 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:06:04.116770 3811 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:06:04.122462 3811 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:44761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/wal
--ranger_kms_url=127.22.49.212:60401/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:43121
--ranger_config_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:43121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:04.123625 3811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:04.124718 3811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:04.133704 3816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:04.133716 3817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:04.133770 3811 server_base.cc:1034] running on GCE node
W20260811 05:06:04.133716 3819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:04.134899 3811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:04.136130 3811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:04.137338 3811 hybrid_clock.cc:648] HybridClock initialized: now 1786424764137307 us; error 45 us; skew 500 ppm
Aug 11 05:06:04 dist-test-slave-w206 krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424764, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:04.147814 3811 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:06:04.148926 3811 webserver.cc:460] Webserver started at http://127.22.49.254:45945/ using document root <none> and password file <none>
I20260811 05:06:04.149559 3811 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:04.149650 3811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:04.149894 3811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:06:04 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424764, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:06:04.209929 3811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "2c2c7fcdd73f430c9a307169ccb43c30"
format_stamp: "Formatted at 2026-08-11 05:06:04 on dist-test-slave-w206"
server_key: "c2753595abacfaf64ae46d2980c95b8b"
server_key_iv: "9e9f57e9e3fd0073fd6dff39289ac0c7"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:04.210623 3811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "2c2c7fcdd73f430c9a307169ccb43c30"
format_stamp: "Formatted at 2026-08-11 05:06:04 on dist-test-slave-w206"
server_key: "c2753595abacfaf64ae46d2980c95b8b"
server_key_iv: "9e9f57e9e3fd0073fd6dff39289ac0c7"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:04.214788 3811 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260811 05:06:04.230142 3826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:04.232018 3811 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:06:04.232198 3811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "2c2c7fcdd73f430c9a307169ccb43c30"
format_stamp: "Formatted at 2026-08-11 05:06:04 on dist-test-slave-w206"
server_key: "c2753595abacfaf64ae46d2980c95b8b"
server_key_iv: "9e9f57e9e3fd0073fd6dff39289ac0c7"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:04.232422 3811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:04.249878 3811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:04.253264 3811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:04.253499 3811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:04.262013 3811 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:43121
I20260811 05:06:04.262015 3883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:43121 every 8 connection(s)
I20260811 05:06:04.263175 3811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:06:04.266119 3884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:04.268100 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 3811
I20260811 05:06:04.268236 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:06:04.268539 22727 external_mini_cluster.cc:1428] Setting key e85f1fbf8186d0dc60ce4703aae371a1
I20260811 05:06:04.273488 3884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30: Bootstrap starting.
I20260811 05:06:04.276074 3884 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:04.277041 3884 log.cc:824] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30: Log is configured to *not* fsync() on all Append() calls
Aug 11 05:06:04 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:04.279609 3884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30: No bootstrap required, opened a new log
I20260811 05:06:04.284114 3884 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43121 } }
I20260811 05:06:04.284463 3884 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:04.284519 3884 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c2c7fcdd73f430c9a307169ccb43c30, State: Initialized, Role: FOLLOWER
I20260811 05:06:04.285032 3884 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43121 } }
I20260811 05:06:04.285212 3884 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:06:04.285317 3884 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:06:04.285432 3884 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:04.286581 3887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:04.270205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52418 (local address 127.22.49.254:43121)
0811 05:06:04.270670 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:04.270690 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:04.270733 (+ 43us) server_negotiation.cc:407] Connection header received
0811 05:06:04.271646 (+ 913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:04.271674 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:04.272101 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:04.272493 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:04.273447 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:04.274874 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:04.276183 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:04.276868 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:04.277033 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:04.280960 (+ 3927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:04.280973 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:04.280994 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:04.281029 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:04.283087 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:04.283607 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:04.283614 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:04.283621 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:04.283756 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:04.284090 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:04.284094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:04.284095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:04.284697 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:04.284918 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:04.285279 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 05:06:04.285587 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":130,"threads_started":1}
I20260811 05:06:04.286652 3884 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43121 } }
I20260811 05:06:04.287043 3884 leader_election.cc:302] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c2c7fcdd73f430c9a307169ccb43c30; no voters:
I20260811 05:06:04.287439 3884 leader_election.cc:288] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:06:04.287564 3889 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:06:04.287794 3889 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 1 LEADER]: Becoming Leader. State: Replica: 2c2c7fcdd73f430c9a307169ccb43c30, State: Running, Role: LEADER
I20260811 05:06:04.288185 3889 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43121 } }
I20260811 05:06:04.288725 3884 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:06:04.289577 3890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c2c7fcdd73f430c9a307169ccb43c30. Latest consensus state: current_term: 1 leader_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43121 } } }
I20260811 05:06:04.289703 3890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:04.290364 3891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43121 } } }
I20260811 05:06:04.290465 3891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:04.290755 3899 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:06:04.291141 3884 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 05:06:04.296725 3899 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:06:04.304291 3899 catalog_manager.cc:1347] Generated new cluster ID: 4afbe9b7c4e741c59ae150a707729fee
I20260811 05:06:04.304375 3899 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:06:04.321076 3899 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:06:04.322129 3899 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:06:04.327911 3899 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30: Generated new TSK 0
I20260811 05:06:04.328676 3899 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:06:05.043260 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.49.212:60401/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43121
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:44761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:05.189385 3932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:05.189761 3932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:05.189850 3932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:05.195516 3932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:05.195598 3932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:05.195685 3932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:06:05.203088 3932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:44761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.22.49.212:60401/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:05.204229 3932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:05.205268 3932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:05.217648 3940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:05.217620 3941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:05.217620 3943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:05.217937 3932 server_base.cc:1034] running on GCE node
I20260811 05:06:05.218482 3932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:05.219204 3932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:05.220430 3932 hybrid_clock.cc:648] HybridClock initialized: now 1786424765220405 us; error 42 us; skew 500 ppm
Aug 11 05:06:05 dist-test-slave-w206 krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:05.224362 3932 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:06:05.225632 3932 webserver.cc:460] Webserver started at http://127.22.49.193:33355/ using document root <none> and password file <none>
I20260811 05:06:05.226398 3932 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:05.226500 3932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:05.226832 3932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:06:05 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:06:05.244239 3932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "c1513efa567c460cab46f25163da350d"
format_stamp: "Formatted at 2026-08-11 05:06:05 on dist-test-slave-w206"
server_key: "b0f483c949fcf94c87331058969c824b"
server_key_iv: "8185875122788c687d278fc88e580d26"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:05.245060 3932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "c1513efa567c460cab46f25163da350d"
format_stamp: "Formatted at 2026-08-11 05:06:05 on dist-test-slave-w206"
server_key: "b0f483c949fcf94c87331058969c824b"
server_key_iv: "8185875122788c687d278fc88e580d26"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:05.250499 3932 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 05:06:05.273775 3950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:05.275524 3932 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 05:06:05.275727 3932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "c1513efa567c460cab46f25163da350d"
format_stamp: "Formatted at 2026-08-11 05:06:05 on dist-test-slave-w206"
server_key: "b0f483c949fcf94c87331058969c824b"
server_key_iv: "8185875122788c687d278fc88e580d26"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:05.275959 3932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:05.304647 3932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:05.308430 3932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:05.308665 3932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:05.309361 3932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:05.310315 3932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:05.310386 3932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:05.310472 3932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:05.310509 3932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:05.321648 3932 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:43311
I20260811 05:06:05.322899 3932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:06:05.326040 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 3932
I20260811 05:06:05.326156 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:06:05.326475 22727 external_mini_cluster.cc:1428] Setting key 9adea9e363d6d366ad193a72bcb6a861
I20260811 05:06:05.327076 4073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:43311 every 8 connection(s)
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
Aug 11 05:06:05 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:05.361598 4078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:05.339149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:42483 (local address 127.22.49.254:43121)
0811 05:06:05.344357 (+ 5208us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:05.344363 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:05.344977 (+ 614us) server_negotiation.cc:407] Connection header received
0811 05:06:05.346387 (+ 1410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:05.346394 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:05.346473 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:05.346599 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:05.348212 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:05.349062 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:05.350735 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:05.351126 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:05.351220 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:05.356439 (+ 5219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:05.356444 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:05.356448 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:05.356481 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:05.358665 (+ 2184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:05.359444 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:05.359448 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:05.359449 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:05.359550 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:05.360108 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:05.360112 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:05.360114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:05.360369 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:05.360488 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:05.361208 (+ 720us) server_negotiation.cc:299] Negotiation successful
0811 05:06:05.361394 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5109,"thread_start_us":98,"threads_started":1}
I20260811 05:06:05.362560 4077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:05.337732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43121 (local address 127.22.49.193:42483)
0811 05:06:05.344713 (+ 6981us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:05.344817 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:05.346021 (+ 1204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:05.346846 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:05.346857 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:05.347313 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:05.348022 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:05.348041 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:05.349220 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:05.349224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:05.350595 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:05.350606 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:05.351411 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:05.351416 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:05.351623 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:05.354179 (+ 2556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:05.354204 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:05.356176 (+ 1972us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:05.358843 (+ 2667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:05.358851 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:05.358869 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:05.359290 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:05.359676 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:05.359680 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:05.359682 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:05.359890 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:05.360513 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:05.360520 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:05.360882 (+ 362us) client_negotiation.cc:769] Sending connection context
0811 05:06:05.361107 (+ 225us) client_negotiation.cc:240] Negotiation successful
0811 05:06:05.361479 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6700,"thread_start_us":167,"threads_started":1}
I20260811 05:06:05.363965 4074 heartbeater.cc:347] Connected to a master server at 127.22.49.254:43121
I20260811 05:06:05.364310 4074 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:05.364933 4074 heartbeater.cc:511] Master 127.22.49.254:43121 requested a full tablet report, sending...
I20260811 05:06:05.366802 3844 ts_manager.cc:194] Registered new tserver with Master: c1513efa567c460cab46f25163da350d (127.22.49.193:43311)
I20260811 05:06:05.368432 3844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:42483
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:06:05.370280 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.49.212:60401/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43121
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:44761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:06:05 dist-test-slave-w206 krb5kdc[3340](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786424765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 05:06:05.521333 4080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:05.521782 4080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:05.521891 4080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:05.528043 4080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:05.528190 4080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:05.528334 4080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:06:05.536388 4080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:44761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.22.49.212:60401/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:05.537918 4080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:05.539434 4080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:05.551900 4089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:05.551934 4087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:05.552500 4086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:05.552852 4080 server_base.cc:1034] running on GCE node
I20260811 05:06:05.553396 4080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:05.554127 4080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:05.555323 4080 hybrid_clock.cc:648] HybridClock initialized: now 1786424765555259 us; error 79 us; skew 500 ppm
Aug 11 05:06:05 dist-test-slave-w206 krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:05.558893 4080 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:06:05.559988 4080 webserver.cc:460] Webserver started at http://127.22.49.194:33139/ using document root <none> and password file <none>
I20260811 05:06:05.560672 4080 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:05.560750 4080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:05.560964 4080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:06:05 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:06:05.584842 4080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "311664e0abc0475ab9f78af036c73e9a"
format_stamp: "Formatted at 2026-08-11 05:06:05 on dist-test-slave-w206"
server_key: "6e821301f7e923d0960ee6f30517287b"
server_key_iv: "3f571a802318696f6d012fa1166760b6"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:05.585638 4080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "311664e0abc0475ab9f78af036c73e9a"
format_stamp: "Formatted at 2026-08-11 05:06:05 on dist-test-slave-w206"
server_key: "6e821301f7e923d0960ee6f30517287b"
server_key_iv: "3f571a802318696f6d012fa1166760b6"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:05.594923 4080 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.003s sys 0.004s
I20260811 05:06:05.619520 4097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:05.621546 4080 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.003s sys 0.000s
I20260811 05:06:05.621706 4080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "311664e0abc0475ab9f78af036c73e9a"
format_stamp: "Formatted at 2026-08-11 05:06:05 on dist-test-slave-w206"
server_key: "6e821301f7e923d0960ee6f30517287b"
server_key_iv: "3f571a802318696f6d012fa1166760b6"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:05.621863 4080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:05.642369 4080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:05.646363 4080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:05.646569 4080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:05.647349 4080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:05.648392 4080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:05.648465 4080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:05.648519 4080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:05.648550 4080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:05.659826 4080 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:38821
I20260811 05:06:05.661082 4080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:06:05.662487 4218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:38821 every 8 connection(s)
I20260811 05:06:05.665066 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 4080
I20260811 05:06:05.665223 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:06:05.665563 22727 external_mini_cluster.cc:1428] Setting key 44a8392bddc309fabc24ccd92f3d0251
Aug 11 05:06:05 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:05.677802 4078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:05.663485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:35157 (local address 127.22.49.254:43121)
0811 05:06:05.663663 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:05.663668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:05.665368 (+ 1700us) server_negotiation.cc:407] Connection header received
0811 05:06:05.666493 (+ 1125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:05.666496 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:05.666540 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:05.666614 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:05.668058 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:05.668904 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:05.670583 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:05.670873 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:05.671038 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:05.673756 (+ 2718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:05.673760 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:05.673762 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:05.673789 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:05.675492 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:05.676049 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:05.676054 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:05.676056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:05.676151 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:05.676549 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:05.676552 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:05.676555 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:05.676776 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:05.676892 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:05.677456 (+ 564us) server_negotiation.cc:299] Negotiation successful
0811 05:06:05.677604 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 05:06:05.678784 4222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:05.664033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43121 (local address 127.22.49.194:35157)
0811 05:06:05.665193 (+ 1160us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:05.665252 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:05.666267 (+ 1015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:05.666807 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:05.666815 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:05.667218 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:05.667878 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:05.667898 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:05.669065 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:05.669069 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:05.670394 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:05.670406 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:05.671088 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:05.671092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:05.671325 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:05.672019 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:05.672038 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:05.673563 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:05.675611 (+ 2048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:05.675618 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:05.675636 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:05.675930 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:05.676263 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:05.676268 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:05.676270 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:05.676434 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:05.676903 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:05.676913 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:05.677193 (+ 280us) client_negotiation.cc:769] Sending connection context
0811 05:06:05.677410 (+ 217us) client_negotiation.cc:240] Negotiation successful
0811 05:06:05.677749 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":925,"thread_start_us":172,"threads_started":1}
I20260811 05:06:05.681094 4219 heartbeater.cc:347] Connected to a master server at 127.22.49.254:43121
I20260811 05:06:05.681403 4219 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:05.682013 4219 heartbeater.cc:511] Master 127.22.49.254:43121 requested a full tablet report, sending...
I20260811 05:06:05.683311 3844 ts_manager.cc:194] Registered new tserver with Master: 311664e0abc0475ab9f78af036c73e9a (127.22.49.194:38821)
I20260811 05:06:05.683944 3844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:35157
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:06:05.710227 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.49.212:60401/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43121
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:44761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:05.874154 4225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:05.874511 4225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:05.874598 4225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
Aug 11 05:06:05 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
W20260811 05:06:05.881091 4225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:05.881187 4225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:05.881287 4225 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:06:05.888859 4225 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:44761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.22.49.212:60401/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:05.890261 4225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:05.891608 4225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:05.910957 4230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:05.911028 4233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:05.911681 4231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:05.915361 4225 server_base.cc:1034] running on GCE node
I20260811 05:06:05.916100 4225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:05.916996 4225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:05.921658 4225 hybrid_clock.cc:648] HybridClock initialized: now 1786424765921575 us; error 87 us; skew 500 ppm
Aug 11 05:06:05 dist-test-slave-w206 krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:05.929661 4225 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:06:05.930944 4225 webserver.cc:460] Webserver started at http://127.22.49.195:44967/ using document root <none> and password file <none>
I20260811 05:06:05.931754 4225 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:05.931861 4225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:05.932120 4225 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 05:06:05 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:06:05.949544 4225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "fc084deea8a44395bf572293ff922a3c"
format_stamp: "Formatted at 2026-08-11 05:06:05 on dist-test-slave-w206"
server_key: "05e1948d0d16c856bab7e357dc734449"
server_key_iv: "1fe96e7f1d3f3bdf00a949a5e5b11469"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:05.950330 4225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "fc084deea8a44395bf572293ff922a3c"
format_stamp: "Formatted at 2026-08-11 05:06:05 on dist-test-slave-w206"
server_key: "05e1948d0d16c856bab7e357dc734449"
server_key_iv: "1fe96e7f1d3f3bdf00a949a5e5b11469"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:05.968765 4225 fs_manager.cc:691] Time spent creating directory manager: real 0.018s user 0.005s sys 0.000s
I20260811 05:06:06.007441 4241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:06.009712 4225 fs_manager.cc:725] Time spent opening block manager: real 0.026s user 0.002s sys 0.000s
I20260811 05:06:06.009867 4225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "fc084deea8a44395bf572293ff922a3c"
format_stamp: "Formatted at 2026-08-11 05:06:05 on dist-test-slave-w206"
server_key: "05e1948d0d16c856bab7e357dc734449"
server_key_iv: "1fe96e7f1d3f3bdf00a949a5e5b11469"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:06.010026 4225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:06.046326 4225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:06.050099 4225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:06.050390 4225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:06.051164 4225 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:06.052217 4225 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:06.052317 4225 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:06.052430 4225 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:06.052496 4225 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:06.062968 4225 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:41727
I20260811 05:06:06.064275 4225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:06:06.071161 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 4225
I20260811 05:06:06.071302 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:06:06.071463 4361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:41727 every 8 connection(s)
I20260811 05:06:06.071687 22727 external_mini_cluster.cc:1428] Setting key 2fcbbea7273ce27c909dc97df6596e63
Aug 11 05:06:06 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:06.090612 4078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:06.073275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:54389 (local address 127.22.49.254:43121)
0811 05:06:06.073495 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:06.073500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:06.075642 (+ 2142us) server_negotiation.cc:407] Connection header received
0811 05:06:06.076822 (+ 1180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:06.076825 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:06.076877 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:06.076926 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:06.078498 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:06.079319 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:06.080976 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:06.081289 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:06.081357 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:06.084585 (+ 3228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:06.084592 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:06.084595 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:06.084631 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:06.088053 (+ 3422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:06.088740 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:06.088744 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:06.088746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:06.088836 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:06.089247 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:06.089250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:06.089252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:06.089518 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:06.089588 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:06.090292 (+ 704us) server_negotiation.cc:299] Negotiation successful
0811 05:06:06.090436 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139}
I20260811 05:06:06.092525 4364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:06.071959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43121 (local address 127.22.49.195:54389)
0811 05:06:06.075491 (+ 3532us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:06.075552 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:06.076591 (+ 1039us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:06.077320 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:06.077329 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:06.077695 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:06.078330 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:06.078348 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:06.079481 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:06.079484 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:06.080836 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:06.080847 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:06.081568 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:06.081571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:06.081764 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:06.082441 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:06.082460 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:06.084307 (+ 1847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:06.088204 (+ 3897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:06.088210 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:06.088228 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:06.088623 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:06.088950 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:06.088952 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:06.088954 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:06.089143 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:06.089681 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:06.089689 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:06.090017 (+ 328us) client_negotiation.cc:769] Sending connection context
0811 05:06:06.091108 (+ 1091us) client_negotiation.cc:240] Negotiation successful
0811 05:06:06.091473 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3294,"thread_start_us":223,"threads_started":1}
I20260811 05:06:06.094041 4362 heartbeater.cc:347] Connected to a master server at 127.22.49.254:43121
I20260811 05:06:06.094272 4362 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:06.094841 4362 heartbeater.cc:511] Master 127.22.49.254:43121 requested a full tablet report, sending...
I20260811 05:06:06.095996 3844 ts_manager.cc:194] Registered new tserver with Master: fc084deea8a44395bf572293ff922a3c (127.22.49.195:41727)
I20260811 05:06:06.096711 3844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:54389
I20260811 05:06:06.100293 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:06:06.101069 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 3932
I20260811 05:06:06.112259 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 4080
I20260811 05:06:06.121513 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 4225
I20260811 05:06:06.129123 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 3811
I20260811 05:06:06.140431 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:43121
--webserver_interface=127.22.49.254
--webserver_port=45945
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:44761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:43121
--ranger_config_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.49.212:60401/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.49.212:60401/kms with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:06.259356 4365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:06.259754 4365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:06.259829 4365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:06.264043 4365 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:06:06.264106 4365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:06.264127 4365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:06.264142 4365 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:06:06.264191 4365 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:06:06.270031 4365 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:44761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.49.212:60401/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:43121
--ranger_config_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:43121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=45945
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:06.271167 4365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:06.272280 4365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:06.281153 4374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:06.280995 4372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:06.280972 4371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:06.281594 4365 server_base.cc:1034] running on GCE node
I20260811 05:06:06.282372 4365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:06.283878 4365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:06.285074 4365 hybrid_clock.cc:648] HybridClock initialized: now 1786424766285049 us; error 55 us; skew 500 ppm
Aug 11 05:06:06 dist-test-slave-w206 krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424766, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:06.288776 4365 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:06:06.290000 4365 webserver.cc:460] Webserver started at http://127.22.49.254:45945/ using document root <none> and password file <none>
I20260811 05:06:06.290683 4365 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:06.290776 4365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 05:06:06 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424766, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:06:06.378496 4365 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.003s
I20260811 05:06:06.390911 4383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:06.392899 4365 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.000s sys 0.002s
I20260811 05:06:06.393062 4365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "2c2c7fcdd73f430c9a307169ccb43c30"
format_stamp: "Formatted at 2026-08-11 05:06:04 on dist-test-slave-w206"
server_key: "c2753595abacfaf64ae46d2980c95b8b"
server_key_iv: "9e9f57e9e3fd0073fd6dff39289ac0c7"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:06.393790 4365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:06.412127 4365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:06.415977 4365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:06.416188 4365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:06.424762 4365 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:43121
I20260811 05:06:06.425045 4438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:43121 every 8 connection(s)
I20260811 05:06:06.426091 4365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:06:06.431332 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 4365
I20260811 05:06:06.431860 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.49.212:60401/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:43311
--local_ip_for_outbound_sockets=127.22.49.193
--tserver_master_addrs=127.22.49.254:43121
--webserver_port=33355
--webserver_interface=127.22.49.193
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:44761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.49.212:60401/kms with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:06:06.431958 4439 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:06:06.434260 4439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30: Bootstrap starting.
I20260811 05:06:06.457218 4439 log.cc:824] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:06.465931 4439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:06:06.466492 4439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30: Bootstrap complete.
I20260811 05:06:06.472014 4439 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43121 } }
I20260811 05:06:06.472575 4439 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c2c7fcdd73f430c9a307169ccb43c30, State: Initialized, Role: FOLLOWER
I20260811 05:06:06.473246 4439 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43121 } }
I20260811 05:06:06.473430 4439 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:06:06.473526 4439 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:06:06.473654 4439 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 1 FOLLOWER]: Advancing to term 2
I20260811 05:06:06.476189 4439 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43121 } }
I20260811 05:06:06.476596 4439 leader_election.cc:302] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c2c7fcdd73f430c9a307169ccb43c30; no voters:
I20260811 05:06:06.476970 4439 leader_election.cc:288] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 05:06:06.478248 4439 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:06:06.480700 4439 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 05:06:06.481912 4443 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 05:06:06.482178 4443 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [term 2 LEADER]: Becoming Leader. State: Replica: 2c2c7fcdd73f430c9a307169ccb43c30, State: Running, Role: LEADER
I20260811 05:06:06.482523 4443 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43121 } }
I20260811 05:06:06.483608 4443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43121 } } }
I20260811 05:06:06.483763 4443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:06.484028 4443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c2c7fcdd73f430c9a307169ccb43c30. Latest consensus state: current_term: 2 leader_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c2c7fcdd73f430c9a307169ccb43c30" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43121 } } }
I20260811 05:06:06.484148 4443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:06.487582 4460 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:06:06.494261 4460 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:06:06.495074 4460 catalog_manager.cc:1259] Loaded cluster ID: 4afbe9b7c4e741c59ae150a707729fee
I20260811 05:06:06.495170 4460 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:06:06.498039 4460 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:06:06.499178 4460 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30: Loaded TSK: 0
I20260811 05:06:06.501076 4460 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 05:06:06.608481 4441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:06.608922 4441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:06.609018 4441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:06.615087 4441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:06.615236 4441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:06.615384 4441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:06:06.623492 4441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:44761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.49.212:60401/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:43311
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=33355
--tserver_master_addrs=127.22.49.254:43121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:06.625058 4441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:06.626441 4441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:06.640190 4474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:06.640730 4476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:06.641057 4473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:06.642380 4441 server_base.cc:1034] running on GCE node
I20260811 05:06:06.642889 4441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:06.643739 4441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:06.651171 4441 hybrid_clock.cc:648] HybridClock initialized: now 1786424766651131 us; error 68 us; skew 500 ppm
Aug 11 05:06:06 dist-test-slave-w206 krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424766, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:06.655112 4441 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:06:06.656288 4441 webserver.cc:460] Webserver started at http://127.22.49.193:33355/ using document root <none> and password file <none>
I20260811 05:06:06.657058 4441 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:06.657217 4441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 05:06:06 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424766, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:06:06.681797 4441 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.002s sys 0.000s
I20260811 05:06:06.685657 4490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:06.687280 4441 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 05:06:06.687407 4441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "c1513efa567c460cab46f25163da350d"
format_stamp: "Formatted at 2026-08-11 05:06:05 on dist-test-slave-w206"
server_key: "b0f483c949fcf94c87331058969c824b"
server_key_iv: "8185875122788c687d278fc88e580d26"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:06.688098 4441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:06.732707 4441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:06.748413 4441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:06.748733 4441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:06.749620 4441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:06.750876 4441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:06.751029 4441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:06.751165 4441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:06.751250 4441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:06.765096 4441 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:43311
I20260811 05:06:06.766458 4441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:06:06.767052 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 4441
I20260811 05:06:06.767575 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.49.212:60401/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:38821
--local_ip_for_outbound_sockets=127.22.49.194
--tserver_master_addrs=127.22.49.254:43121
--webserver_port=33139
--webserver_interface=127.22.49.194
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:44761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.49.212:60401/kms with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:06:06.774115 4618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:43311 every 8 connection(s)
Aug 11 05:06:06 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424766, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:06.798007 4622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:06.776657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43121 (local address 127.22.49.193:37677)
0811 05:06:06.780291 (+ 3634us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:06.780348 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:06.781394 (+ 1046us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:06.783301 (+ 1907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:06.783309 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:06.783658 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:06.784321 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:06.784343 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:06.786242 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:06.786245 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:06.787582 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:06.787594 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:06.788870 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:06.788874 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:06.789064 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:06.789795 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:06.789816 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:06.791570 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:06.794238 (+ 2668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:06.794245 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:06.794261 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:06.794636 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:06.795129 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:06.795132 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:06.795134 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:06.795314 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:06.796115 (+ 801us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:06.796122 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:06.796417 (+ 295us) client_negotiation.cc:769] Sending connection context
0811 05:06:06.796609 (+ 192us) client_negotiation.cc:240] Negotiation successful
0811 05:06:06.796958 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3413,"thread_start_us":170,"threads_started":1}
I20260811 05:06:06.799755 4623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:06.778313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:37677 (local address 127.22.49.254:43121)
0811 05:06:06.779957 (+ 1644us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:06.780003 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:06.781723 (+ 1720us) server_negotiation.cc:407] Connection header received
0811 05:06:06.782043 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:06.782056 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:06.782453 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:06.782789 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:06.784535 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:06.786085 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:06.787724 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:06.788459 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:06.788638 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:06.791819 (+ 3181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:06.791826 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:06.791842 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:06.791875 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:06.794088 (+ 2213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:06.794794 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:06.794801 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:06.794807 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:06.795007 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:06.795425 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:06.795429 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:06.795431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:06.795931 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:06.796059 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:06.798545 (+ 2486us) server_negotiation.cc:299] Negotiation successful
0811 05:06:06.798832 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1441,"thread_start_us":131,"threads_started":1}
I20260811 05:06:06.803043 4619 heartbeater.cc:347] Connected to a master server at 127.22.49.254:43121
I20260811 05:06:06.803313 4619 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:06.803988 4619 heartbeater.cc:511] Master 127.22.49.254:43121 requested a full tablet report, sending...
W20260811 05:06:06.806595 4619 heartbeater.cc:644] Failed to heartbeat to 127.22.49.254:43121 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 05:06:06.806739 4619 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:06.806933 4619 heartbeater.cc:511] Master 127.22.49.254:43121 requested a full tablet report, sending...
I20260811 05:06:06.808248 4619 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:06.808470 4619 heartbeater.cc:511] Master 127.22.49.254:43121 requested a full tablet report, sending...
W20260811 05:06:06.809382 4619 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 05:06:06.963219 4621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:06.963640 4621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:06.963780 4621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:06.970155 4621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:06.970254 4621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:06.970362 4621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:06:06.976205 4621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:44761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.49.212:60401/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:38821
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=33139
--tserver_master_addrs=127.22.49.254:43121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:06.977406 4621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:06.978585 4621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:06.990837 4629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:06.990943 4631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:06.991397 4621 server_base.cc:1034] running on GCE node
W20260811 05:06:06.991325 4628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:06.991935 4621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:06.992690 4621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:06.996009 4621 hybrid_clock.cc:648] HybridClock initialized: now 1786424766995966 us; error 47 us; skew 500 ppm
Aug 11 05:06:06 dist-test-slave-w206 krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424766, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:06.999306 4621 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:06:07.000432 4621 webserver.cc:460] Webserver started at http://127.22.49.194:33139/ using document root <none> and password file <none>
I20260811 05:06:07.001010 4621 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:07.001116 4621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 05:06:07 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424766, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:06:07.022521 4621 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:06:07.025223 4639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:07.026695 4621 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:06:07.026863 4621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "311664e0abc0475ab9f78af036c73e9a"
format_stamp: "Formatted at 2026-08-11 05:06:05 on dist-test-slave-w206"
server_key: "6e821301f7e923d0960ee6f30517287b"
server_key_iv: "3f571a802318696f6d012fa1166760b6"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:07.027493 4621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:07.040302 4621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:07.043613 4621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:07.043831 4621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:07.044519 4621 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:07.045439 4621 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:07.045512 4621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:07.045576 4621 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:07.045629 4621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:07.057135 4621 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:38821
I20260811 05:06:07.057725 4763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:38821 every 8 connection(s)
I20260811 05:06:07.058300 4621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:06:07.061087 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 4621
I20260811 05:06:07.061583 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.49.212:60401/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:41727
--local_ip_for_outbound_sockets=127.22.49.195
--tserver_master_addrs=127.22.49.254:43121
--webserver_port=44967
--webserver_interface=127.22.49.195
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:44761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.49.212:60401/kms with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:06:07 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424766, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:07.076159 4623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:07.060425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:46263 (local address 127.22.49.254:43121)
0811 05:06:07.060594 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:07.060599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:07.063514 (+ 2915us) server_negotiation.cc:407] Connection header received
0811 05:06:07.064769 (+ 1255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:07.064773 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:07.064844 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:07.064923 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:07.066492 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:07.067260 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:07.068648 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:07.069025 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:07.069120 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:07.072401 (+ 3281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:07.072405 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:07.072408 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:07.072438 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:07.073980 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:07.074519 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:07.074526 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:07.074528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:07.074614 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:07.074995 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:07.075001 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:07.075006 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:07.075196 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:07.075309 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:07.075820 (+ 511us) server_negotiation.cc:299] Negotiation successful
0811 05:06:07.075967 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 05:06:07.077033 4766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:07.060812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43121 (local address 127.22.49.194:46263)
0811 05:06:07.063317 (+ 2505us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:07.063379 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:07.064513 (+ 1134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:07.065155 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:07.065164 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:07.065565 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:07.066282 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:07.066304 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:07.067434 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:07.067438 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:07.068445 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:07.068456 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:07.069338 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:07.069343 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:07.069551 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:07.070329 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:07.070352 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:07.072195 (+ 1843us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:07.074108 (+ 1913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:07.074114 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:07.074130 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:07.074407 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:07.074719 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:07.074722 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:07.074724 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:07.074871 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:07.075307 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:07.075314 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:07.075582 (+ 268us) client_negotiation.cc:769] Sending connection context
0811 05:06:07.075779 (+ 197us) client_negotiation.cc:240] Negotiation successful
0811 05:06:07.076095 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2257,"thread_start_us":154,"threads_started":1}
I20260811 05:06:07.078349 4764 heartbeater.cc:347] Connected to a master server at 127.22.49.254:43121
I20260811 05:06:07.078619 4764 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:07.079245 4764 heartbeater.cc:511] Master 127.22.49.254:43121 requested a full tablet report, sending...
W20260811 05:06:07.080852 4764 heartbeater.cc:644] Failed to heartbeat to 127.22.49.254:43121 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 05:06:07.080991 4764 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:07.081204 4764 heartbeater.cc:511] Master 127.22.49.254:43121 requested a full tablet report, sending...
I20260811 05:06:07.082001 4764 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:07.082229 4764 heartbeater.cc:511] Master 127.22.49.254:43121 requested a full tablet report, sending...
W20260811 05:06:07.083006 4764 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 05:06:07.237865 4767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:07.238224 4767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:07.238287 4767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:07.244580 4767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:07.244676 4767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:07.244767 4767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:06:07.252928 4767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:44761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.49.212:60401/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:41727
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=44967
--tserver_master_addrs=127.22.49.254:43121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:07.254635 4767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:07.256141 4767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:07.268471 4773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:07.268482 4775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:07.268469 4777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:07.268913 4767 server_base.cc:1034] running on GCE node
I20260811 05:06:07.269434 4767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:07.270190 4767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:07.271428 4767 hybrid_clock.cc:648] HybridClock initialized: now 1786424767271408 us; error 36 us; skew 500 ppm
Aug 11 05:06:07 dist-test-slave-w206 krb5kdc[3340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424767, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:07.275103 4767 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:06:07.276405 4767 webserver.cc:460] Webserver started at http://127.22.49.195:44967/ using document root <none> and password file <none>
I20260811 05:06:07.277114 4767 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:07.277221 4767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 05:06:07 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424767, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:06:07.296911 4767 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 05:06:07.300635 4787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:07.302510 4767 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 05:06:07.302714 4767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "fc084deea8a44395bf572293ff922a3c"
format_stamp: "Formatted at 2026-08-11 05:06:05 on dist-test-slave-w206"
server_key: "05e1948d0d16c856bab7e357dc734449"
server_key_iv: "1fe96e7f1d3f3bdf00a949a5e5b11469"
server_key_version: "kuduclusterkey@0"
I20260811 05:06:07.303822 4767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:07.317795 4767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:07.321043 4767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:07.321336 4767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:07.321954 4767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:07.322870 4767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:07.322942 4767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:07.323047 4767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:07.323092 4767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:07.334821 4767 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:41727
I20260811 05:06:07.335052 4906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:41727 every 8 connection(s)
I20260811 05:06:07.335980 4767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:06:07.336982 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 4767
Aug 11 05:06:07 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424767, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:07.351333 4910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:07.339184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:39771 (local address 127.22.49.254:43121)
0811 05:06:07.339443 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:07.339449 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:07.340175 (+ 726us) server_negotiation.cc:407] Connection header received
0811 05:06:07.341212 (+ 1037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:07.341215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:07.341281 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:07.341391 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:07.342512 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:07.343150 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:07.344524 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:07.344782 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:07.344929 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:07.347496 (+ 2567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:07.347499 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:07.347501 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:07.347526 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:07.349085 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:07.349628 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:07.349632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:07.349634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:07.349725 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:07.350096 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:07.350101 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:07.350102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:07.350331 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:07.350435 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:07.350966 (+ 531us) server_negotiation.cc:299] Negotiation successful
0811 05:06:07.351127 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":91,"threads_started":1}
I20260811 05:06:07.352253 4911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:07.339522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43121 (local address 127.22.49.195:39771)
0811 05:06:07.340018 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:07.340073 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:07.340981 (+ 908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:07.341573 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:07.341580 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:07.341859 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:07.342353 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:07.342367 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:07.343285 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:07.343289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:07.344377 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:07.344387 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:07.344968 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:07.344972 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:07.345154 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:07.345839 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:07.345862 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:07.347303 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:07.349212 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:07.349218 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:07.349236 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:07.349518 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:07.349827 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:07.349830 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:07.349832 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:07.349996 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:07.350443 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:07.350452 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:07.350717 (+ 265us) client_negotiation.cc:769] Sending connection context
0811 05:06:07.350925 (+ 208us) client_negotiation.cc:240] Negotiation successful
0811 05:06:07.351277 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":140,"threads_started":1}
I20260811 05:06:07.353520 4907 heartbeater.cc:347] Connected to a master server at 127.22.49.254:43121
I20260811 05:06:07.353766 4907 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:07.354285 4907 heartbeater.cc:511] Master 127.22.49.254:43121 requested a full tablet report, sending...
W20260811 05:06:07.355813 4907 heartbeater.cc:644] Failed to heartbeat to 127.22.49.254:43121 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 05:06:07.355949 4907 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:07.356138 4907 heartbeater.cc:511] Master 127.22.49.254:43121 requested a full tablet report, sending...
I20260811 05:06:07.356943 4907 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:07.357127 4907 heartbeater.cc:511] Master 127.22.49.254:43121 requested a full tablet report, sending...
W20260811 05:06:07.357872 4907 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 05:06:07.366659 4623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:07.338140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46486 (local address 127.22.49.254:43121)
0811 05:06:07.338277 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:07.338280 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:07.358821 (+ 20541us) server_negotiation.cc:407] Connection header received
0811 05:06:07.358958 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:07.358961 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:07.359067 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:07.359176 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:07.360039 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:07.360577 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:07.361461 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:07.361795 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:07.361890 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:07.363478 (+ 1588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:07.363482 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:07.363485 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:07.363510 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:07.364986 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:07.365411 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:07.365416 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:07.365418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:07.365504 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:07.365788 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:07.365792 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:07.365794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:07.365980 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:07.366205 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:07.366347 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 05:06:07.366474 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 05:06:07.809625 4619 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:07.809965 4619 heartbeater.cc:511] Master 127.22.49.254:43121 requested a full tablet report, sending...
I20260811 05:06:07.811121 4402 ts_manager.cc:194] Registered new tserver with Master: c1513efa567c460cab46f25163da350d (127.22.49.193:43311)
I20260811 05:06:07.812382 4402 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:37677
Aug 11 05:06:07 dist-test-slave-w206 krb5kdc[3340](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786424767, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:08.083256 4764 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:08.083606 4764 heartbeater.cc:511] Master 127.22.49.254:43121 requested a full tablet report, sending...
I20260811 05:06:08.084470 4402 ts_manager.cc:194] Registered new tserver with Master: 311664e0abc0475ab9f78af036c73e9a (127.22.49.194:38821)
I20260811 05:06:08.085297 4402 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:46263
Aug 11 05:06:08 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424767, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:06:08.358101 4907 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:08.358424 4907 heartbeater.cc:511] Master 127.22.49.254:43121 requested a full tablet report, sending...
I20260811 05:06:08.359179 4402 ts_manager.cc:194] Registered new tserver with Master: fc084deea8a44395bf572293ff922a3c (127.22.49.195:41727)
I20260811 05:06:08.359809 4402 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:39771
I20260811 05:06:08.369340 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:06:08.383934 4932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.370945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46498 (local address 127.22.49.254:43121)
0811 05:06:08.375195 (+ 4250us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:08.375199 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:08.375212 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:06:08.375248 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:08.375250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:08.375291 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:08.375408 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:08.376138 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.376676 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.378310 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.378618 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.378728 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.380515 (+ 1787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:08.380519 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:08.380521 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:08.380556 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:08.382122 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:08.382564 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:08.382569 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:08.382571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:08.382658 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:08.382947 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:08.382950 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:08.382952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:08.383196 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:08.383342 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:08.383584 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 05:06:08.383714 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4179,"thread_start_us":113,"threads_started":1}
I20260811 05:06:08.387615 4402 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46498:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:06:08.391078 4402 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:06:08.410169 4937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.401398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38821 (local address 127.0.0.1:35984)
0811 05:06:08.402292 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:08.402355 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:08.402535 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:08.405331 (+ 2796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:08.405334 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:08.405347 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:08.405436 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:08.405444 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.406953 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.406957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:08.408379 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:08.408390 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.409588 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.409592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:08.409711 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.409759 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 05:06:08.409866 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 05:06:08.410001 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"thread_start_us":114,"threads_started":1}
I20260811 05:06:08.412297 4939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.401549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35984 (local address 127.22.49.194:38821)
0811 05:06:08.404918 (+ 3369us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:08.404925 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:08.404947 (+ 22us) server_negotiation.cc:407] Connection header received
0811 05:06:08.405019 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:08.405026 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:08.405192 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:08.405600 (+ 408us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:08.405776 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.406808 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.408627 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.409457 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.411776 (+ 2319us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.411961 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:08.412022 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 05:06:08.412144 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3239,"thread_start_us":80,"threads_started":1}
I20260811 05:06:08.413806 4938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.402718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:41727 (local address 127.0.0.1:33174)
0811 05:06:08.404550 (+ 1832us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:08.404563 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:08.404655 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:08.405250 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:08.405256 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:08.405279 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:08.405574 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:08.405582 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.409895 (+ 4313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.409898 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:08.411628 (+ 1730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:08.411635 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.413419 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.413423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:08.413507 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.413530 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 05:06:08.413595 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 05:06:08.413668 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1775,"thread_start_us":112,"threads_started":1}
I20260811 05:06:08.413859 4942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.403196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33174 (local address 127.22.49.195:41727)
0811 05:06:08.403482 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:08.403490 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:08.404685 (+ 1195us) server_negotiation.cc:407] Connection header received
0811 05:06:08.404772 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:08.404777 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:08.404965 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:08.405101 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:08.405708 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.408508 (+ 2800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.412705 (+ 4197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.413270 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.413422 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.413574 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:08.413625 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 05:06:08.413714 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":122,"threads_started":1}
I20260811 05:06:08.415457 4941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.401504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:43311 (local address 127.0.0.1:53018)
0811 05:06:08.402953 (+ 1449us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:08.402968 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:08.403084 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:08.404385 (+ 1301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:08.404391 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:08.404414 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:08.404554 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:08.404564 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.410290 (+ 5726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.410294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:08.411475 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:08.411486 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.415069 (+ 3583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.415073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:08.415163 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.415187 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 05:06:08.415259 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 05:06:08.415331 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1382,"thread_start_us":90,"threads_started":1}
I20260811 05:06:08.415921 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.401668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53018 (local address 127.22.49.193:43311)
0811 05:06:08.403812 (+ 2144us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:08.403818 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:08.403853 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:06:08.403934 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:08.403939 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:08.404159 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:08.404309 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:08.406691 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.409751 (+ 3060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.411634 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.414640 (+ 3006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.414748 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.414898 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:08.415657 (+ 759us) server_negotiation.cc:299] Negotiation successful
0811 05:06:08.415763 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2037,"thread_start_us":138,"threads_started":1}
I20260811 05:06:08.415936 4685 tablet_service.cc:1467] Processing CreateTablet for tablet 900b4134d2194cd896f4958ffe73a71c (DEFAULT_TABLE table=test-table [id=a446d3b97ecd4ebda613e6db585c4a88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:06:08.417042 4839 tablet_service.cc:1467] Processing CreateTablet for tablet 900b4134d2194cd896f4958ffe73a71c (DEFAULT_TABLE table=test-table [id=a446d3b97ecd4ebda613e6db585c4a88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:06:08.418092 4839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 900b4134d2194cd896f4958ffe73a71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:08.418893 4547 tablet_service.cc:1467] Processing CreateTablet for tablet 900b4134d2194cd896f4958ffe73a71c (DEFAULT_TABLE table=test-table [id=a446d3b97ecd4ebda613e6db585c4a88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:06:08.420010 4547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 900b4134d2194cd896f4958ffe73a71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:08.427374 4685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 900b4134d2194cd896f4958ffe73a71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:08.440457 4944 tablet_bootstrap.cc:492] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d: Bootstrap starting.
I20260811 05:06:08.443219 4944 tablet_bootstrap.cc:654] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:08.443360 4943 tablet_bootstrap.cc:492] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a: Bootstrap starting.
I20260811 05:06:08.444554 4944 log.cc:824] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:08.445617 4943 tablet_bootstrap.cc:654] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:08.446727 4943 log.cc:824] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:08.447479 4945 tablet_bootstrap.cc:492] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c: Bootstrap starting.
I20260811 05:06:08.449671 4945 tablet_bootstrap.cc:654] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:08.449970 4944 tablet_bootstrap.cc:492] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d: No bootstrap required, opened a new log
I20260811 05:06:08.450232 4944 ts_tablet_manager.cc:1397] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260811 05:06:08.450503 4945 log.cc:824] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:08.452767 4945 tablet_bootstrap.cc:492] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c: No bootstrap required, opened a new log
I20260811 05:06:08.452950 4945 ts_tablet_manager.cc:1397] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 05:06:08.455065 4944 raft_consensus.cc:348] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "311664e0abc0475ab9f78af036c73e9a" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38821 } } peers { permanent_uuid: "c1513efa567c460cab46f25163da350d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43311 } } peers { permanent_uuid: "fc084deea8a44395bf572293ff922a3c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41727 } }
I20260811 05:06:08.455374 4944 raft_consensus.cc:374] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:08.455430 4944 raft_consensus.cc:729] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1513efa567c460cab46f25163da350d, State: Initialized, Role: FOLLOWER
I20260811 05:06:08.455977 4944 consensus_queue.cc:260] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "311664e0abc0475ab9f78af036c73e9a" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38821 } } peers { permanent_uuid: "c1513efa567c460cab46f25163da350d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43311 } } peers { permanent_uuid: "fc084deea8a44395bf572293ff922a3c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41727 } }
I20260811 05:06:08.456923 4945 raft_consensus.cc:348] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "311664e0abc0475ab9f78af036c73e9a" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38821 } } peers { permanent_uuid: "c1513efa567c460cab46f25163da350d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43311 } } peers { permanent_uuid: "fc084deea8a44395bf572293ff922a3c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41727 } }
I20260811 05:06:08.457165 4945 raft_consensus.cc:374] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:08.457173 4944 ts_tablet_manager.cc:1428] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 05:06:08.457206 4945 raft_consensus.cc:729] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc084deea8a44395bf572293ff922a3c, State: Initialized, Role: FOLLOWER
I20260811 05:06:08.457594 4619 heartbeater.cc:503] Master 127.22.49.254:43121 was elected leader, sending a full tablet report...
I20260811 05:06:08.457624 4945 consensus_queue.cc:260] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "311664e0abc0475ab9f78af036c73e9a" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38821 } } peers { permanent_uuid: "c1513efa567c460cab46f25163da350d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43311 } } peers { permanent_uuid: "fc084deea8a44395bf572293ff922a3c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41727 } }
I20260811 05:06:08.458552 4945 ts_tablet_manager.cc:1428] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c: Time spent starting tablet: real 0.006s user 0.000s sys 0.005s
I20260811 05:06:08.460041 4907 heartbeater.cc:503] Master 127.22.49.254:43121 was elected leader, sending a full tablet report...
I20260811 05:06:08.464609 4943 tablet_bootstrap.cc:492] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a: No bootstrap required, opened a new log
I20260811 05:06:08.464828 4943 ts_tablet_manager.cc:1397] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.000s
I20260811 05:06:08.469007 4943 raft_consensus.cc:348] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "311664e0abc0475ab9f78af036c73e9a" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38821 } } peers { permanent_uuid: "c1513efa567c460cab46f25163da350d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43311 } } peers { permanent_uuid: "fc084deea8a44395bf572293ff922a3c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41727 } }
I20260811 05:06:08.469405 4943 raft_consensus.cc:374] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:08.469501 4943 raft_consensus.cc:729] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 311664e0abc0475ab9f78af036c73e9a, State: Initialized, Role: FOLLOWER
I20260811 05:06:08.469990 4943 consensus_queue.cc:260] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "311664e0abc0475ab9f78af036c73e9a" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38821 } } peers { permanent_uuid: "c1513efa567c460cab46f25163da350d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43311 } } peers { permanent_uuid: "fc084deea8a44395bf572293ff922a3c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41727 } }
I20260811 05:06:08.470767 4764 heartbeater.cc:503] Master 127.22.49.254:43121 was elected leader, sending a full tablet report...
I20260811 05:06:08.471241 4943 ts_tablet_manager.cc:1428] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260811 05:06:08.527354 4620 tablet.cc:2369] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:06:08.545866 4951 raft_consensus.cc:482] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:06:08.546131 4951 raft_consensus.cc:504] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "311664e0abc0475ab9f78af036c73e9a" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38821 } } peers { permanent_uuid: "c1513efa567c460cab46f25163da350d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43311 } } peers { permanent_uuid: "fc084deea8a44395bf572293ff922a3c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41727 } }
I20260811 05:06:08.547225 4950 raft_consensus.cc:482] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:06:08.547422 4950 raft_consensus.cc:504] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "311664e0abc0475ab9f78af036c73e9a" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38821 } } peers { permanent_uuid: "c1513efa567c460cab46f25163da350d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43311 } } peers { permanent_uuid: "fc084deea8a44395bf572293ff922a3c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41727 } }
I20260811 05:06:08.548543 4950 leader_election.cc:288] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 311664e0abc0475ab9f78af036c73e9a (127.22.49.194:38821), c1513efa567c460cab46f25163da350d (127.22.49.193:43311)
I20260811 05:06:08.548655 4951 leader_election.cc:288] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1513efa567c460cab46f25163da350d (127.22.49.193:43311), fc084deea8a44395bf572293ff922a3c (127.22.49.195:41727)
I20260811 05:06:08.554177 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.549195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:60029 (local address 127.22.49.193:43311)
0811 05:06:08.549522 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:08.549527 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:08.549543 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:06:08.549599 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:08.549602 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:08.549647 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:08.549725 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:08.550429 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.551248 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.552862 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.553453 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.553548 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.553599 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:08.553967 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 05:06:08.554044 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255}
I20260811 05:06:08.554651 4942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.549589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:60007 (local address 127.22.49.195:41727)
0811 05:06:08.549684 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:08.549688 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:08.550338 (+ 650us) server_negotiation.cc:407] Connection header received
0811 05:06:08.550493 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:08.550496 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:08.550530 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:08.550568 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:08.550942 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.551671 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.553161 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.553775 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.553869 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.553915 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:08.554460 (+ 545us) server_negotiation.cc:299] Negotiation successful
0811 05:06:08.554540 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 05:06:08.554912 4952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.547769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:43311 (local address 127.22.49.194:60029)
0811 05:06:08.548940 (+ 1171us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:08.548954 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:08.549061 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:08.550100 (+ 1039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:08.550103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:08.550123 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:08.550270 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:08.550277 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.551409 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.551412 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:08.552702 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:08.552714 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.553702 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.553705 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:08.553804 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.553828 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 05:06:08.554634 (+ 806us) client_negotiation.cc:240] Negotiation successful
0811 05:06:08.554714 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1096,"thread_start_us":132,"threads_started":1}
I20260811 05:06:08.555672 4568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "900b4134d2194cd896f4958ffe73a71c" candidate_uuid: "311664e0abc0475ab9f78af036c73e9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1513efa567c460cab46f25163da350d" is_pre_election: true
I20260811 05:06:08.555985 4568 raft_consensus.cc:2454] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 311664e0abc0475ab9f78af036c73e9a in term 0.
I20260811 05:06:08.556511 4641 leader_election.cc:302] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 311664e0abc0475ab9f78af036c73e9a, c1513efa567c460cab46f25163da350d; no voters:
I20260811 05:06:08.559312 4951 raft_consensus.cc:2781] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:06:08.559420 4951 raft_consensus.cc:482] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:06:08.559466 4951 raft_consensus.cc:3037] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:08.559700 4939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.549943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:56189 (local address 127.22.49.194:38821)
0811 05:06:08.550047 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:08.550051 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:08.555356 (+ 5305us) server_negotiation.cc:407] Connection header received
0811 05:06:08.555594 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:08.555597 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:08.555639 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:08.555684 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:08.556085 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.556747 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.558415 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.559032 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.559129 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.559173 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:08.559526 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 05:06:08.559593 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 05:06:08.560140 4956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.549368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38821 (local address 127.22.49.195:56189)
0811 05:06:08.555270 (+ 5902us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:08.555285 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:08.555474 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:08.555797 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:08.555800 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:08.555816 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:08.555951 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:08.555958 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.556904 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.556907 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:08.558117 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:08.558128 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.559277 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.559280 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:08.559379 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.559402 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 05:06:08.559888 (+ 486us) client_negotiation.cc:240] Negotiation successful
0811 05:06:08.559993 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5840,"thread_start_us":101,"threads_started":1}
W20260811 05:06:08.560205 4765 tablet.cc:2369] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:06:08.560961 4951 raft_consensus.cc:504] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "311664e0abc0475ab9f78af036c73e9a" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38821 } } peers { permanent_uuid: "c1513efa567c460cab46f25163da350d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43311 } } peers { permanent_uuid: "fc084deea8a44395bf572293ff922a3c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41727 } }
I20260811 05:06:08.561311 4951 leader_election.cc:288] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [CANDIDATE]: Term 1 election: Requested vote from peers c1513efa567c460cab46f25163da350d (127.22.49.193:43311), fc084deea8a44395bf572293ff922a3c (127.22.49.195:41727)
I20260811 05:06:08.561615 4696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "900b4134d2194cd896f4958ffe73a71c" candidate_uuid: "fc084deea8a44395bf572293ff922a3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "311664e0abc0475ab9f78af036c73e9a" is_pre_election: true
I20260811 05:06:08.561828 4696 raft_consensus.cc:2379] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc084deea8a44395bf572293ff922a3c in current term 1: Already voted for candidate 311664e0abc0475ab9f78af036c73e9a in this term.
I20260811 05:06:08.562937 4568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "900b4134d2194cd896f4958ffe73a71c" candidate_uuid: "311664e0abc0475ab9f78af036c73e9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1513efa567c460cab46f25163da350d"
I20260811 05:06:08.563103 4568 raft_consensus.cc:3037] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:08.564666 4568 raft_consensus.cc:2454] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 311664e0abc0475ab9f78af036c73e9a in term 1.
I20260811 05:06:08.565479 4641 leader_election.cc:302] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 311664e0abc0475ab9f78af036c73e9a, c1513efa567c460cab46f25163da350d; no voters:
I20260811 05:06:08.565702 4951 raft_consensus.cc:2781] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:06:08.565909 4951 raft_consensus.cc:686] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [term 1 LEADER]: Becoming Leader. State: Replica: 311664e0abc0475ab9f78af036c73e9a, State: Running, Role: LEADER
I20260811 05:06:08.565930 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.549263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:55367 (local address 127.22.49.193:43311)
0811 05:06:08.554341 (+ 5078us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:08.554345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:08.554357 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:06:08.554393 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:08.554396 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:08.554436 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:08.554509 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:08.562332 (+ 7823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.563067 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.564591 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.565192 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.565290 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.565336 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:08.565698 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 05:06:08.565779 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5025,"thread_start_us":116,"threads_started":1}
I20260811 05:06:08.566279 4954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.548879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:43311 (local address 127.22.49.195:55367)
0811 05:06:08.549940 (+ 1061us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:08.549953 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:08.550042 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:08.555085 (+ 5043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:08.560933 (+ 5848us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:08.560961 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:08.562176 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:08.562188 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.563220 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.563227 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:08.564433 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:08.564444 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.565438 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.565441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:08.565541 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.565563 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 05:06:08.566053 (+ 490us) client_negotiation.cc:240] Negotiation successful
0811 05:06:08.566134 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1008,"thread_start_us":102,"threads_started":1}
I20260811 05:06:08.566249 4951 consensus_queue.cc:237] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "311664e0abc0475ab9f78af036c73e9a" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38821 } } peers { permanent_uuid: "c1513efa567c460cab46f25163da350d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43311 } } peers { permanent_uuid: "fc084deea8a44395bf572293ff922a3c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41727 } }
I20260811 05:06:08.566742 4953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.548391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:41727 (local address 127.22.49.194:60007)
0811 05:06:08.550257 (+ 1866us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:08.550269 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:08.550396 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:08.550685 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:08.550688 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:08.550701 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:08.550822 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:08.550827 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.551841 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.551844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:08.553013 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:08.553025 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.554012 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.554016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:08.554117 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.554138 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 05:06:08.566512 (+ 12374us) client_negotiation.cc:240] Negotiation successful
0811 05:06:08.566593 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1805,"mutex_wait_us":4,"thread_start_us":86,"threads_started":1}
I20260811 05:06:08.567876 4845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "900b4134d2194cd896f4958ffe73a71c" candidate_uuid: "311664e0abc0475ab9f78af036c73e9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc084deea8a44395bf572293ff922a3c" is_pre_election: true
I20260811 05:06:08.567881 4859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "900b4134d2194cd896f4958ffe73a71c" candidate_uuid: "311664e0abc0475ab9f78af036c73e9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc084deea8a44395bf572293ff922a3c"
I20260811 05:06:08.568080 4845 raft_consensus.cc:2454] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 311664e0abc0475ab9f78af036c73e9a in term 0.
I20260811 05:06:08.569001 4568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "900b4134d2194cd896f4958ffe73a71c" candidate_uuid: "fc084deea8a44395bf572293ff922a3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1513efa567c460cab46f25163da350d" is_pre_election: true
I20260811 05:06:08.569171 4568 raft_consensus.cc:2379] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc084deea8a44395bf572293ff922a3c in current term 1: Already voted for candidate 311664e0abc0475ab9f78af036c73e9a in this term.
I20260811 05:06:08.569574 4789 leader_election.cc:302] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc084deea8a44395bf572293ff922a3c; no voters: 311664e0abc0475ab9f78af036c73e9a, c1513efa567c460cab46f25163da350d
I20260811 05:06:08.569865 4950 raft_consensus.cc:3037] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:08.571241 4950 raft_consensus.cc:2726] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 05:06:08.573024 4402 catalog_manager.cc:5495] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a reported cstate change: term changed from 0 to 1, leader changed from <none> to 311664e0abc0475ab9f78af036c73e9a (127.22.49.194). New cstate: current_term: 1 leader_uuid: "311664e0abc0475ab9f78af036c73e9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "311664e0abc0475ab9f78af036c73e9a" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1513efa567c460cab46f25163da350d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc084deea8a44395bf572293ff922a3c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41727 } health_report { overall_health: UNKNOWN } } }
W20260811 05:06:08.589730 4908 tablet.cc:2369] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 05:06:08 dist-test-slave-w206 krb5kdc[3340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424767, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for HTTP/127.22.49.212@KRBTEST.COM
I20260811 05:06:08.614769 4939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.609676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35998 (local address 127.22.49.194:38821)
0811 05:06:08.610092 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:08.610097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:08.610110 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:06:08.610198 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:08.610201 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:08.610265 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:08.610380 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:06:08.610750 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.611564 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.612761 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:08.613086 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:08.613177 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:08.613573 (+ 396us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:06:08.614130 (+ 557us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:06:08.614241 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:08.614562 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 05:06:08.614616 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332}
I20260811 05:06:08.629247 4859 raft_consensus.cc:1261] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c [term 1 FOLLOWER]: Refusing update from remote peer 311664e0abc0475ab9f78af036c73e9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:06:08.629283 4568 raft_consensus.cc:1261] T 900b4134d2194cd896f4958ffe73a71c P c1513efa567c460cab46f25163da350d [term 1 FOLLOWER]: Refusing update from remote peer 311664e0abc0475ab9f78af036c73e9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:06:08.629984 4951 consensus_queue.cc:1035] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1513efa567c460cab46f25163da350d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:06:08.630496 4957 consensus_queue.cc:1035] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc084deea8a44395bf572293ff922a3c" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 41727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:06:08.645100 4961 mvcc.cc:205] Tried to move back new op lower bound from 7317195852296380416 to 7317195852051374080. Current Snapshot: MvccSnapshot[applied={T|T < 7317195852296380416}]
I20260811 05:06:08.645648 4962 mvcc.cc:205] Tried to move back new op lower bound from 7317195852296380416 to 7317195852051374080. Current Snapshot: MvccSnapshot[applied={T|T < 7317195852296380416}]
I20260811 05:06:08.660878 4402 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:06:08.661089 4402 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:06:08.663925 4402 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2c2c7fcdd73f430c9a307169ccb43c30: Sending DeleteTablet for 3 replicas of tablet 900b4134d2194cd896f4958ffe73a71c
I20260811 05:06:08.664719 4685 tablet_service.cc:1514] Processing DeleteTablet for tablet 900b4134d2194cd896f4958ffe73a71c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:08 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:35984
I20260811 05:06:08.664929 4839 tablet_service.cc:1514] Processing DeleteTablet for tablet 900b4134d2194cd896f4958ffe73a71c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:08 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:33174
I20260811 05:06:08.664983 4547 tablet_service.cc:1514] Processing DeleteTablet for tablet 900b4134d2194cd896f4958ffe73a71c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:08 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:53018
I20260811 05:06:08.666227 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 4441
I20260811 05:06:08.671485 4963 mvcc.cc:205] Tried to move back new op lower bound from 7317195852296380416 to 7317195852051374080. Current Snapshot: MvccSnapshot[applied={T|T < 7317195852296380416}]
I20260811 05:06:08.680896 4970 tablet_replica.cc:330] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a: stopping tablet replica
I20260811 05:06:08.681344 4970 raft_consensus.cc:2229] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:06:08.685618 4970 raft_consensus.cc:2258] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:06:08.687204 4972 tablet_replica.cc:330] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c: stopping tablet replica
I20260811 05:06:08.687561 4970 ts_tablet_manager.cc:1905] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:06:08.687618 4972 raft_consensus.cc:2229] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:06:08.688014 4972 raft_consensus.cc:2258] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:06:08.689586 4972 ts_tablet_manager.cc:1905] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:06:08.690585 4970 ts_tablet_manager.cc:1918] T 900b4134d2194cd896f4958ffe73a71c P 311664e0abc0475ab9f78af036c73e9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260811 05:06:08.691371 4385 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:43311 (error 108)
I20260811 05:06:08.692507 4972 ts_tablet_manager.cc:1918] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:06:08.692608 4972 log.cc:1196] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/900b4134d2194cd896f4958ffe73a71c
I20260811 05:06:08.693028 4972 ts_tablet_manager.cc:1939] T 900b4134d2194cd896f4958ffe73a71c P fc084deea8a44395bf572293ff922a3c: Deleting consensus metadata
I20260811 05:06:08.694203 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 4621
I20260811 05:06:08.694628 4938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:08.694267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:43311 (local address 127.0.0.1:53022)
0811 05:06:08.694430 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:08.694519 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:43311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 05:06:08.696802 4385 catalog_manager.cc:4584] TS c1513efa567c460cab46f25163da350d (127.22.49.193:43311): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 900b4134d2194cd896f4958ffe73a71c: Network error: Client connection negotiation failed: client connection to 127.22.49.193:43311: connect: Connection refused (error 111)
I20260811 05:06:08.704365 4385 catalog_manager.cc:4841] TS fc084deea8a44395bf572293ff922a3c (127.22.49.195:41727): tablet 900b4134d2194cd896f4958ffe73a71c (table test-table [id=a446d3b97ecd4ebda613e6db585c4a88]) successfully deleted
W20260811 05:06:08.706212 4938 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:06:08.705524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38821 (local address 127.0.0.1:36010)
0811 05:06:08.705716 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:08.705731 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:08.705862 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:08.706090 (+ 228us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.194:38821: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":108}
I20260811 05:06:08.707042 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 4767
I20260811 05:06:08.729070 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 4365
I20260811 05:06:08.744599 22727 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 05:06:09.090477 22727 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 05:06:09.090634 22727 mini_ranger.cc:66] Stopping Ranger...
I20260811 05:06:09.436231 22727 mini_ranger.cc:68] Stopped Ranger
2026-08-11 05:06:09.436 UTC [3373] LOG: received smart shutdown request
2026-08-11 05:06:09.441 UTC [3373] LOG: background worker "logical replication launcher" (PID 3382) exited with exit code 1
2026-08-11 05:06:09.442 UTC [3377] LOG: shutting down
2026-08-11 05:06:09.631 UTC [3373] LOG: database system is shut down
2026-08-11T05:06:09Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52232 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:06:09 dist-test-slave-w206 krb5kdc[4984](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:06:09 dist-test-slave-w206 krb5kdc[4984](info): set up 2 sockets
Aug 11 05:06:09 dist-test-slave-w206 krb5kdc[4984](info): commencing operation
krb5kdc: starting...
W20260811 05:06:10.917446 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:06:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:06:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:06:11.051131 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:44129
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:45125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:44129,127.22.49.253:46205,127.22.49.252:34531
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:11.170200 4998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:11.170496 4998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:11.170540 4998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:11.174705 4998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:06:11.174782 4998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:11.174810 4998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:11.174829 4998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:06:11.174844 4998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:06:11.180451 4998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:45125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:44129,127.22.49.253:46205,127.22.49.252:34531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:44129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:11.181591 4998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:11.182590 4998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:11.191370 5003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:11.191366 5004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:11.191485 4998 server_base.cc:1034] running on GCE node
W20260811 05:06:11.191366 5006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:11.192180 4998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:11.193327 4998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:11.194541 4998 hybrid_clock.cc:648] HybridClock initialized: now 1786424771194511 us; error 40 us; skew 500 ppm
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:11.197502 4998 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:06:11.198427 4998 webserver.cc:460] Webserver started at http://127.22.49.254:46035/ using document root <none> and password file <none>
I20260811 05:06:11.199045 4998 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:11.199137 4998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:11.199389 4998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:06:11.201452 4998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "8900d24cd760443fbf0d4100f931198e"
format_stamp: "Formatted at 2026-08-11 05:06:11 on dist-test-slave-w206"
server_key: "9bee321a479e049b830a9ee9a9357260"
server_key_iv: "42fbc4909d61c99bcc5dadfd1fb9de6a"
server_key_version: "encryptionkey@0"
I20260811 05:06:11.202031 4998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "8900d24cd760443fbf0d4100f931198e"
format_stamp: "Formatted at 2026-08-11 05:06:11 on dist-test-slave-w206"
server_key: "9bee321a479e049b830a9ee9a9357260"
server_key_iv: "42fbc4909d61c99bcc5dadfd1fb9de6a"
server_key_version: "encryptionkey@0"
I20260811 05:06:11.205889 4998 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 05:06:11.208441 5013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:11.209725 4998 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 05:06:11.209880 4998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "8900d24cd760443fbf0d4100f931198e"
format_stamp: "Formatted at 2026-08-11 05:06:11 on dist-test-slave-w206"
server_key: "9bee321a479e049b830a9ee9a9357260"
server_key_iv: "42fbc4909d61c99bcc5dadfd1fb9de6a"
server_key_version: "encryptionkey@0"
I20260811 05:06:11.210000 4998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:11.230468 4998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:11.233769 4998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:11.234012 4998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:11.241823 4998 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:44129
I20260811 05:06:11.241852 5070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:44129 every 8 connection(s)
I20260811 05:06:11.242857 4998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:06:11.245779 5071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:11.248879 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 4998
I20260811 05:06:11.249020 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:06:11.249332 22727 external_mini_cluster.cc:1428] Setting key b1c418306db42eb1a920b4c3831f584a
I20260811 05:06:11.249862 5071 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.49.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.253@KRBTEST.COM" created.
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:11.268582 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.252811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:44129 (local address 127.0.0.1:54814)
0811 05:06:11.253323 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.253368 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:11.254262 (+ 894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:11.254937 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:11.254942 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:11.255412 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:11.255642 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.255655 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.256806 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.256808 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.257520 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.257529 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.258174 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.258178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.258274 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.258917 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:11.258934 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:11.262376 (+ 3442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:11.265130 (+ 2754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.265141 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.265153 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.265421 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.265816 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.265819 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.265821 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.265956 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.266638 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:11.266645 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:11.266807 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 05:06:11.267018 (+ 211us) client_negotiation.cc:240] Negotiation successful
0811 05:06:11.267392 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"spinlock_wait_cycles":1408,"thread_start_us":143,"threads_started":1}
I20260811 05:06:11.268582 5076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.253746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54814 (local address 127.22.49.254:44129)
0811 05:06:11.254074 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:11.254085 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:11.254128 (+ 43us) server_negotiation.cc:407] Connection header received
0811 05:06:11.254570 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:11.254574 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:11.254743 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:11.254938 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:11.255809 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.256662 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.257644 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.258022 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.258194 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.262555 (+ 4361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:11.262562 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:11.262573 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:11.262595 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:11.265001 (+ 2406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.265568 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.265580 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.265581 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.265693 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.266064 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.266070 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.266072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.266505 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:11.266667 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:11.267087 (+ 420us) server_negotiation.cc:299] Negotiation successful
0811 05:06:11.267450 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":140,"server-negotiator.queue_time_us":223,"thread_start_us":102,"threads_started":1}
I20260811 05:06:11.271499 5071 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:06:11.272431 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.272111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:46205 (local address 127.0.0.1:38880)
0811 05:06:11.272242 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.272359 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:46205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 05:06:11.272689 5017 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.49.253:46205: connect: Connection refused (error 111)
I20260811 05:06:11.273607 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.273401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:46205 (local address 127.0.0.1:38882)
0811 05:06:11.273508 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.273555 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:46205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 05:06:11.273823 5071 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.253:46205: Network error: Client connection negotiation failed: client connection to 127.22.49.253:46205: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.253.keytab.
Entry for principal kudu/127.22.49.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.253.keytab.
I20260811 05:06:11.280174 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.253:46205
--webserver_interface=127.22.49.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.253.keytab
--principal=kudu/127.22.49.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:45125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:44129,127.22.49.253:46205,127.22.49.252:34531
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:06:11.323091 5071 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } attempt: 1
I20260811 05:06:11.324182 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.323780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:46205 (local address 127.0.0.1:38886)
0811 05:06:11.323991 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.324079 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:46205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 05:06:11.324985 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.324750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:46205 (local address 127.0.0.1:38888)
0811 05:06:11.324863 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.324918 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:46205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 05:06:11.325212 5071 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.253:46205: Network error: Client connection negotiation failed: client connection to 127.22.49.253:46205: connect: Connection refused (error 111)
W20260811 05:06:11.392577 5080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:11.392865 5080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:11.392906 5080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 05:06:11.393399 5071 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } attempt: 2
I20260811 05:06:11.394258 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.393929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:46205 (local address 127.0.0.1:38890)
0811 05:06:11.394099 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.394170 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:46205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 05:06:11.395038 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.394790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:46205 (local address 127.0.0.1:38894)
0811 05:06:11.394899 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.394949 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:46205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 05:06:11.395200 5071 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.253:46205: Network error: Client connection negotiation failed: client connection to 127.22.49.253:46205: connect: Connection refused (error 111)
W20260811 05:06:11.397521 5080 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:06:11.397614 5080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:11.397660 5080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:11.397717 5080 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:06:11.397755 5080 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:06:11.403429 5080 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:45125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:44129,127.22.49.253:46205,127.22.49.252:34531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.253.keytab
--principal=kudu/127.22.49.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.253:46205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.49.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:11.404582 5080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:11.405644 5080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:11.414608 5088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:11.414610 5086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:11.414602 5085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:11.414927 5080 server_base.cc:1034] running on GCE node
I20260811 05:06:11.415649 5080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:11.416774 5080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:11.417939 5080 hybrid_clock.cc:648] HybridClock initialized: now 1786424771417913 us; error 38 us; skew 500 ppm
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:11.420879 5080 init.cc:377] Logged in from keytab as kudu/127.22.49.253@KRBTEST.COM (short username kudu)
I20260811 05:06:11.421787 5080 webserver.cc:460] Webserver started at http://127.22.49.253:44533/ using document root <none> and password file <none>
I20260811 05:06:11.422398 5080 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:11.422497 5080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:11.422729 5080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:06:11.424860 5080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/data/instance:
uuid: "3570294747b344d98bef228ba7bfc63e"
format_stamp: "Formatted at 2026-08-11 05:06:11 on dist-test-slave-w206"
server_key: "d0ef5f53e3c974259038aa5d454af718"
server_key_iv: "687729580f7f00c0ee5f127cd85ff844"
server_key_version: "encryptionkey@0"
I20260811 05:06:11.425437 5080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/wal/instance:
uuid: "3570294747b344d98bef228ba7bfc63e"
format_stamp: "Formatted at 2026-08-11 05:06:11 on dist-test-slave-w206"
server_key: "d0ef5f53e3c974259038aa5d454af718"
server_key_iv: "687729580f7f00c0ee5f127cd85ff844"
server_key_version: "encryptionkey@0"
I20260811 05:06:11.429152 5080 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260811 05:06:11.431687 5095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:11.432973 5080 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:06:11.433120 5080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/wal
uuid: "3570294747b344d98bef228ba7bfc63e"
format_stamp: "Formatted at 2026-08-11 05:06:11 on dist-test-slave-w206"
server_key: "d0ef5f53e3c974259038aa5d454af718"
server_key_iv: "687729580f7f00c0ee5f127cd85ff844"
server_key_version: "encryptionkey@0"
I20260811 05:06:11.433231 5080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:11.448050 5080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:11.451217 5080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:11.451439 5080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:11.458938 5080 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.253:46205
I20260811 05:06:11.458992 5154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.253:46205 every 8 connection(s)
I20260811 05:06:11.459998 5080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/data/info.pb
I20260811 05:06:11.462790 5155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:11.466602 5155 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:06:11.467597 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 5080
I20260811 05:06:11.467727 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-1/wal/instance
I20260811 05:06:11.468031 22727 external_mini_cluster.cc:1428] Setting key fac57579c9e35e0fba1280776f60dd32
WARNING: no policy specified for kudu/127.22.49.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.252@KRBTEST.COM" created.
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.253@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:11.484910 5076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.468884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54818 (local address 127.22.49.254:44129)
0811 05:06:11.469060 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:11.469066 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:11.470009 (+ 943us) server_negotiation.cc:407] Connection header received
0811 05:06:11.471082 (+ 1073us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:11.471088 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:11.471158 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:11.471260 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:11.472711 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.473634 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.474897 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.475342 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.475462 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.480833 (+ 5371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:11.480836 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:11.480838 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:11.480871 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:11.482391 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.483095 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.483097 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.483098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.483171 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.483591 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.483594 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.483595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.483777 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:11.483849 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:11.484656 (+ 807us) server_negotiation.cc:299] Negotiation successful
0811 05:06:11.484773 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 05:06:11.486184 5158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.469258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:44129 (local address 127.0.0.1:54818)
0811 05:06:11.469838 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.469899 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:11.470837 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:11.471440 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:11.471446 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:11.471774 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:11.472251 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.472270 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.473790 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.473793 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.474746 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.474757 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.475515 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.475518 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.475666 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.476311 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:11.476328 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:11.480643 (+ 4315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:11.482523 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.482531 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.482551 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.482993 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.483265 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.483271 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.483276 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.483481 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.483893 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:11.483903 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:11.484289 (+ 386us) client_negotiation.cc:769] Sending connection context
0811 05:06:11.484530 (+ 241us) client_negotiation.cc:240] Negotiation successful
0811 05:06:11.484965 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":132,"threads_started":1}
I20260811 05:06:11.486476 5071 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } attempt: 3
I20260811 05:06:11.488008 5155 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.253@KRBTEST.COM for kudu/127.22.49.253@KRBTEST.COM
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for kudu/127.22.49.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.252.keytab.
Entry for principal kudu/127.22.49.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.252.keytab.
I20260811 05:06:11.499316 5158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.488534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:46205 (local address 127.0.0.1:38908)
0811 05:06:11.488706 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.488720 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:11.488789 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:11.489183 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:11.489186 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:11.489416 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:11.489523 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.489530 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.490658 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.490661 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.491437 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.491452 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.491911 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.491914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.492002 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.492533 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:11.492545 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:11.493962 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:11.497676 (+ 3714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.497679 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.497680 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.497869 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.498152 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.498157 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.498159 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.498288 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.498720 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:11.498723 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:11.498815 (+ 92us) client_negotiation.cc:769] Sending connection context
0811 05:06:11.498945 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 05:06:11.499124 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"mutex_wait_us":45,"spinlock_wait_cycles":8064}
I20260811 05:06:11.499454 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.486999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:46205 (local address 127.0.0.1:38900)
0811 05:06:11.487117 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.487144 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:11.487237 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:11.488090 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:11.488093 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:11.488284 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:11.488421 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.488433 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.489996 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.489999 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.490886 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.490897 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.491793 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.491796 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.491911 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.492615 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:11.492636 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:11.494603 (+ 1967us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:11.497329 (+ 2726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.497334 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.497340 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.497566 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.498008 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.498012 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.498014 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.498117 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.498773 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:11.498777 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:11.498909 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 05:06:11.499065 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 05:06:11.499237 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 05:06:11.499661 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.252:34531
--webserver_interface=127.22.49.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.252.keytab
--principal=kudu/127.22.49.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:45125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:44129,127.22.49.253:46205,127.22.49.252:34531
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:06:11.499456 5162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.488583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38908 (local address 127.22.49.253:46205)
0811 05:06:11.488940 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:11.488949 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:11.488968 (+ 19us) server_negotiation.cc:407] Connection header received
0811 05:06:11.489008 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:11.489011 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:11.489053 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:11.489143 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:11.489666 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.490538 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.491545 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.491799 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.491911 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.494129 (+ 2218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:11.494138 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:11.494150 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:11.494168 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:11.497173 (+ 3005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.497973 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.497978 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.497980 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.498062 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.498383 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.498387 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.498389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.498614 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:11.498765 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:11.499084 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 05:06:11.499241 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":245,"thread_start_us":95,"threads_started":1}
I20260811 05:06:11.500149 5161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.487325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38900 (local address 127.22.49.253:46205)
0811 05:06:11.487696 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:11.487708 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:11.487730 (+ 22us) server_negotiation.cc:407] Connection header received
0811 05:06:11.487772 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:11.487780 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:11.487958 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:11.488104 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:11.488767 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.489853 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.491078 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.491658 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.491789 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.494811 (+ 3022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:11.494814 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:11.494816 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:11.494839 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:11.497210 (+ 2371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.497750 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.497759 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.497761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.497890 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.498236 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.498239 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.498242 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.498644 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:11.499671 (+ 1027us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:11.499781 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 05:06:11.499921 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":274,"spinlock_wait_cycles":2560,"thread_start_us":156,"threads_started":1}
I20260811 05:06:11.502035 5071 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:06:11.502127 5155 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:06:11.502862 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.502572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:34531 (local address 127.0.0.1:46216)
0811 05:06:11.502698 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.502753 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 05:06:11.502964 5158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.502597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:34531 (local address 127.0.0.1:46232)
0811 05:06:11.502773 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.502889 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260811 05:06:11.503175 5097 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
I20260811 05:06:11.504428 5158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.504132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:34531 (local address 127.0.0.1:46238)
0811 05:06:11.504298 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.504349 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260811 05:06:11.504597 5155 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:34531: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
I20260811 05:06:11.504690 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.504425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:34531 (local address 127.0.0.1:46242)
0811 05:06:11.504580 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.504635 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260811 05:06:11.504845 5071 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:34531: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
I20260811 05:06:11.536024 5071 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } attempt: 1
I20260811 05:06:11.536991 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.536671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:34531 (local address 127.0.0.1:46250)
0811 05:06:11.536827 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.536903 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 05:06:11.537696 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.537481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:34531 (local address 127.0.0.1:46254)
0811 05:06:11.537588 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.537636 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 05:06:11.537839 5071 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:34531: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
I20260811 05:06:11.553886 5155 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } attempt: 1
I20260811 05:06:11.554913 5158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.554546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:34531 (local address 127.0.0.1:46256)
0811 05:06:11.554732 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.554817 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 05:06:11.555759 5158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.555523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:34531 (local address 127.0.0.1:46264)
0811 05:06:11.555636 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.555694 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 05:06:11.555920 5155 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:34531: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
I20260811 05:06:11.613020 5071 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } attempt: 2
I20260811 05:06:11.613897 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.613590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:34531 (local address 127.0.0.1:46268)
0811 05:06:11.613745 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.613812 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 05:06:11.614673 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.614451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:34531 (local address 127.0.0.1:46276)
0811 05:06:11.614562 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.614616 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 05:06:11.614866 5071 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:34531: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
W20260811 05:06:11.616393 5163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:11.616671 5163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:11.616776 5163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:11.620904 5163 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:06:11.620982 5163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:11.621026 5163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:11.621090 5163 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:06:11.621129 5163 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:06:11.624082 5155 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } attempt: 2
I20260811 05:06:11.624840 5158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.624529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:34531 (local address 127.0.0.1:46284)
0811 05:06:11.624685 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.624749 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 05:06:11.625520 5158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.625307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:34531 (local address 127.0.0.1:46290)
0811 05:06:11.625411 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.625459 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 05:06:11.625646 5155 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:34531: Network error: Client connection negotiation failed: client connection to 127.22.49.252:34531: connect: Connection refused (error 111)
I20260811 05:06:11.627168 5163 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:45125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:44129,127.22.49.253:46205,127.22.49.252:34531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.252.keytab
--principal=kudu/127.22.49.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.252:34531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.49.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5163
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:11.628245 5163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:11.629240 5163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:11.637845 5171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:11.637887 5170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:11.637861 5173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:11.638100 5163 server_base.cc:1034] running on GCE node
I20260811 05:06:11.638810 5163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:11.639901 5163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:11.641075 5163 hybrid_clock.cc:648] HybridClock initialized: now 1786424771641048 us; error 38 us; skew 500 ppm
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:11.644001 5163 init.cc:377] Logged in from keytab as kudu/127.22.49.252@KRBTEST.COM (short username kudu)
I20260811 05:06:11.644965 5163 webserver.cc:460] Webserver started at http://127.22.49.252:37595/ using document root <none> and password file <none>
I20260811 05:06:11.645509 5163 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:11.645570 5163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:11.645807 5163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:06:11.647886 5163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/data/instance:
uuid: "36e964dadcc249669e3f8f3105868db4"
format_stamp: "Formatted at 2026-08-11 05:06:11 on dist-test-slave-w206"
server_key: "e48db883463b450290a8c9fee5602e4a"
server_key_iv: "b20825a31d212066ef31dbb4cb0a7cdb"
server_key_version: "encryptionkey@0"
I20260811 05:06:11.648449 5163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/wal/instance:
uuid: "36e964dadcc249669e3f8f3105868db4"
format_stamp: "Formatted at 2026-08-11 05:06:11 on dist-test-slave-w206"
server_key: "e48db883463b450290a8c9fee5602e4a"
server_key_iv: "b20825a31d212066ef31dbb4cb0a7cdb"
server_key_version: "encryptionkey@0"
I20260811 05:06:11.652182 5163 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260811 05:06:11.654592 5181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:11.656037 5163 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:06:11.656204 5163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/wal
uuid: "36e964dadcc249669e3f8f3105868db4"
format_stamp: "Formatted at 2026-08-11 05:06:11 on dist-test-slave-w206"
server_key: "e48db883463b450290a8c9fee5602e4a"
server_key_iv: "b20825a31d212066ef31dbb4cb0a7cdb"
server_key_version: "encryptionkey@0"
I20260811 05:06:11.656332 5163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:11.667341 5163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:11.670447 5163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:11.670665 5163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:11.678100 5163 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.252:34531
I20260811 05:06:11.678148 5236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.252:34531 every 8 connection(s)
I20260811 05:06:11.679175 5163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/data/info.pb
I20260811 05:06:11.682021 5237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:11.685882 5237 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:06:11.688663 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 5163
I20260811 05:06:11.688800 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786424592714304-22727-0/minicluster-data/master-2/wal/instance
I20260811 05:06:11.689162 22727 external_mini_cluster.cc:1428] Setting key cea792a96c116f28ba82e3d4cf4a0460
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.252@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.252@KRBTEST.COM
I20260811 05:06:11.702163 5076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.687922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54820 (local address 127.22.49.254:44129)
0811 05:06:11.688107 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:11.688112 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:11.689102 (+ 990us) server_negotiation.cc:407] Connection header received
0811 05:06:11.690354 (+ 1252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:11.690358 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:11.690425 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:11.690530 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:11.691767 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.692599 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.694024 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.694353 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.694477 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.697497 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:11.697502 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:11.697505 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:11.697535 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:11.699992 (+ 2457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.700532 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.700535 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.700536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.700630 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.700992 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.700995 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.700996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.701202 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:11.701336 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:11.701829 (+ 493us) server_negotiation.cc:299] Negotiation successful
0811 05:06:11.701973 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 05:06:11.703346 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.689922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46300 (local address 127.22.49.252:34531)
0811 05:06:11.690325 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:11.690338 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:11.690414 (+ 76us) server_negotiation.cc:407] Connection header received
0811 05:06:11.690561 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:11.690566 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:11.690761 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:11.690907 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:11.691856 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.693005 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.694179 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.694727 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.694822 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.698028 (+ 3206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:11.698039 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:11.698056 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:11.698095 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:11.699952 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.700477 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.700486 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.700491 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.700613 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.700949 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.700956 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.700957 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.701408 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:11.701611 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:11.701894 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 05:06:11.702389 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":312,"server-negotiator.queue_time_us":275,"thread_start_us":172,"threads_started":1}
I20260811 05:06:11.703347 5239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.688288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:44129 (local address 127.0.0.1:54820)
0811 05:06:11.688873 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.688935 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:11.690043 (+ 1108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:11.690644 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:11.690651 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:11.691177 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:11.691593 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.691613 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.692751 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.692754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.693879 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.693890 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.694516 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.694519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.694669 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.695522 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:11.695547 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:11.697265 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:11.700149 (+ 2884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.700157 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.700166 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.700395 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.700756 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.700759 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.700760 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.700870 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.701366 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:11.701373 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:11.701513 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 05:06:11.701699 (+ 186us) client_negotiation.cc:240] Negotiation successful
0811 05:06:11.702084 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":133,"threads_started":1}
I20260811 05:06:11.704674 5237 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.252@KRBTEST.COM for kudu/127.22.49.253@KRBTEST.COM
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:11.714018 5071 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } attempt: 3
I20260811 05:06:11.715068 5239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.705247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:46205 (local address 127.0.0.1:38924)
0811 05:06:11.705636 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.705648 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:11.705717 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:11.706052 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:11.706055 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:11.706246 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:11.706376 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.706383 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.707505 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.707508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.708383 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.708393 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.709023 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.709026 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.709143 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.709613 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:11.709628 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:11.710950 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:11.713133 (+ 2183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.713139 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.713142 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.713405 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.713760 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.713763 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.713765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.713853 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.714300 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:11.714303 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:11.714426 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 05:06:11.714643 (+ 217us) client_negotiation.cc:240] Negotiation successful
0811 05:06:11.714825 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327}
I20260811 05:06:11.715083 5162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.705370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38924 (local address 127.22.49.253:46205)
0811 05:06:11.705514 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:11.705520 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:11.705711 (+ 191us) server_negotiation.cc:407] Connection header received
0811 05:06:11.705850 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:11.705853 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:11.705924 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:11.706012 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:11.706564 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.707400 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.708515 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.708901 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.709014 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.711145 (+ 2131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:11.711148 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:11.711150 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:11.711176 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:11.712962 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.713541 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.713545 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.713551 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.713649 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.713944 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.713948 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.713950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.714187 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:11.714302 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:11.714715 (+ 413us) server_negotiation.cc:299] Negotiation successful
0811 05:06:11.714862 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 05:06:11.716351 5237 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:06:11.716665 5076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.706174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54826 (local address 127.22.49.254:44129)
0811 05:06:11.706323 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:11.706329 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:11.706347 (+ 18us) server_negotiation.cc:407] Connection header received
0811 05:06:11.706382 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:11.706385 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:11.706432 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:11.706510 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:11.707350 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.708110 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.709152 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.709517 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.709633 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.712153 (+ 2520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:11.712156 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:11.712159 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:11.712189 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:11.714113 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.714738 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.714742 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.714744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.714844 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.715255 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.715261 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.715264 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.715554 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:11.715838 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:11.716378 (+ 540us) server_negotiation.cc:299] Negotiation successful
0811 05:06:11.716512 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":57}
I20260811 05:06:11.716792 5155 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } attempt: 3
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for kudu/127.22.49.252@KRBTEST.COM
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.253@KRBTEST.COM for kudu/127.22.49.252@KRBTEST.COM
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.252@KRBTEST.COM for kudu/127.22.49.252@KRBTEST.COM
Aug 11 05:06:11 dist-test-slave-w206 krb5kdc[4984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424771, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.253@KRBTEST.COM
I20260811 05:06:11.725576 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.714429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:34531 (local address 127.0.0.1:46306)
0811 05:06:11.714621 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.714637 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:11.714713 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:11.715114 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:11.715119 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:11.715298 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:11.715415 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.715421 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.716468 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.716474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.717267 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.717281 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.719570 (+ 2289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.719574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.719662 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.720167 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:11.720181 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:11.721653 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:11.723966 (+ 2313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.723971 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.723973 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.724233 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.724528 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.724531 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.724533 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.724621 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.725009 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:11.725014 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:11.725114 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 05:06:11.725221 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 05:06:11.725399 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":1}
I20260811 05:06:11.725575 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.714499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46306 (local address 127.22.49.252:34531)
0811 05:06:11.714877 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:11.714881 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:11.714894 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:06:11.714926 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:11.714929 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:11.714968 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:11.715515 (+ 547us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:11.715583 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.716348 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.717393 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.719438 (+ 2045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.719865 (+ 427us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.721802 (+ 1937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:11.721806 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:11.721810 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:11.721843 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:11.723876 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.724340 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.724345 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.724347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.724428 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.724719 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.724724 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.724726 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.724904 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:11.725005 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:11.725276 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 05:06:11.725395 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":299,"spinlock_wait_cycles":768}
I20260811 05:06:11.729821 5239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.717590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:34531 (local address 127.0.0.1:46316)
0811 05:06:11.717924 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.717946 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:11.718010 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:11.718419 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:11.718422 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:11.718615 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:11.718711 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.718718 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.720202 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.720206 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.720977 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.720988 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.721731 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.721735 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.721872 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.723112 (+ 1240us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:11.723129 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:11.725740 (+ 2611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:11.728245 (+ 2505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.728251 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.728253 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.728542 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.728836 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.728838 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.728840 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.728915 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.729354 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:11.729356 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:11.729430 (+ 74us) client_negotiation.cc:769] Sending connection context
0811 05:06:11.729520 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 05:06:11.729657 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":23}
I20260811 05:06:11.729990 5071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e: Bootstrap starting.
I20260811 05:06:11.730324 5243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.717626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46316 (local address 127.22.49.252:34531)
0811 05:06:11.717998 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:11.718007 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:11.718021 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:06:11.718112 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:11.718115 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:11.718155 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:11.718274 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:11.718836 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.719738 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.721122 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.721521 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.721624 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.725914 (+ 4290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:11.725918 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:11.725920 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:11.725943 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:11.728118 (+ 2175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.728648 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.728650 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.728654 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.728742 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.728996 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.728999 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.729000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.729219 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:11.729321 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:11.730044 (+ 723us) server_negotiation.cc:299] Negotiation successful
0811 05:06:11.730157 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":300,"spinlock_wait_cycles":4352,"thread_start_us":168,"threads_started":1}
I20260811 05:06:11.731048 5162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.718316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38940 (local address 127.22.49.253:46205)
0811 05:06:11.718435 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:11.718440 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:11.718455 (+ 15us) server_negotiation.cc:407] Connection header received
0811 05:06:11.718497 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:11.718500 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:11.718547 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:11.718632 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:11.719603 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.720388 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.721471 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.721854 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.721973 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.726509 (+ 4536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:11.726514 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:11.726518 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:11.726550 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:11.728547 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.729184 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.729191 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.729195 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.729306 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.729659 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.729663 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.729665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.730082 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:11.730305 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:11.730705 (+ 400us) server_negotiation.cc:299] Negotiation successful
0811 05:06:11.730833 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":53}
I20260811 05:06:11.732491 5158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.717180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:34531 (local address 127.0.0.1:46310)
0811 05:06:11.717591 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:11.717607 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:11.717677 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:11.718464 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:11.718467 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:11.718654 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:11.718777 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.718788 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.719985 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.719988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.720861 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:11.720872 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.721623 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.721627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:11.722152 (+ 525us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.722758 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:11.722777 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:11.725246 (+ 2469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:11.729396 (+ 4150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.729401 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.729403 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.729674 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.731000 (+ 1326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:11.731007 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:11.731009 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:11.731124 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:11.731934 (+ 810us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:11.731938 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:11.732040 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 05:06:11.732127 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 05:06:11.732289 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"mutex_wait_us":389}
I20260811 05:06:11.732928 5071 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:11.733489 5242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.717734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46310 (local address 127.22.49.252:34531)
0811 05:06:11.718198 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:11.718209 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:11.718221 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:06:11.718267 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:11.718270 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:11.718321 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:11.718910 (+ 589us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:11.719087 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.719843 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.721007 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.721484 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.721731 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.725427 (+ 3696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:11.725432 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:11.725435 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:11.725462 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:11.729257 (+ 3795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.729812 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.729816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.729818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.730314 (+ 496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.731568 (+ 1254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.731575 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.731580 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.731804 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:11.733067 (+ 1263us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:11.733151 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 05:06:11.733292 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":405,"spinlock_wait_cycles":4096,"thread_start_us":86,"threads_started":1}
I20260811 05:06:11.733633 5071 log.cc:824] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:11.733817 5237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4: Bootstrap starting.
I20260811 05:06:11.736308 5237 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:11.736559 5155 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e: Bootstrap starting.
I20260811 05:06:11.737210 5237 log.cc:824] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:11.738797 5155 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:11.739553 5155 log.cc:824] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:11.739686 5237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4: No bootstrap required, opened a new log
I20260811 05:06:11.741379 5071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e: No bootstrap required, opened a new log
I20260811 05:06:11.741379 5155 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e: No bootstrap required, opened a new log
I20260811 05:06:11.741742 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:06:11.744849 5237 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } }
I20260811 05:06:11.745100 5237 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:11.745160 5237 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36e964dadcc249669e3f8f3105868db4, State: Initialized, Role: FOLLOWER
I20260811 05:06:11.745373 5071 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } }
I20260811 05:06:11.745373 5155 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } }
I20260811 05:06:11.745584 5071 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:11.745584 5155 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:11.745641 5155 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3570294747b344d98bef228ba7bfc63e, State: Initialized, Role: FOLLOWER
I20260811 05:06:11.745641 5071 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8900d24cd760443fbf0d4100f931198e, State: Initialized, Role: FOLLOWER
I20260811 05:06:11.745672 5237 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } }
I20260811 05:06:11.746071 5071 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } }
I20260811 05:06:11.746071 5155 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } }
I20260811 05:06:11.746569 5252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } } }
I20260811 05:06:11.746797 5252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:06:11.747282 5237 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:06:11.747292 5155 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:06:11.747292 5071 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:06:11.747219 5251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } } }
I20260811 05:06:11.748827 5251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:06:11.750893 5253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } } }
I20260811 05:06:11.751245 5253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:06:11.759663 4998 master_runner.cc:263] No leader master found from master 8900d24cd760443fbf0d4100f931198e
I20260811 05:06:11.759755 4998 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 05:06:11.760787 5291 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:06:11.760892 5291 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:06:11.762405 5242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.747941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46324 (local address 127.22.49.252:34531)
0811 05:06:11.748077 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:11.748084 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:11.750685 (+ 2601us) server_negotiation.cc:407] Connection header received
0811 05:06:11.750929 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:11.750932 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:11.751052 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:11.751110 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:11.752235 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.753036 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.754798 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.755425 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.755551 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.757881 (+ 2330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:11.757887 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:11.757890 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:11.757919 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:11.760070 (+ 2151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.760877 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.760880 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.760882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.760988 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.761341 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.761344 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.761346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.761567 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:11.761704 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:11.762068 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 05:06:11.762213 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 05:06:11.762547 5080 master_runner.cc:263] No leader master found from master 3570294747b344d98bef228ba7bfc63e
I20260811 05:06:11.762616 5080 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 05:06:11.762708 5163 master_runner.cc:263] No leader master found from master 36e964dadcc249669e3f8f3105868db4
I20260811 05:06:11.762755 5163 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 05:06:11.764124 5285 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:06:11.764213 5285 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260811 05:06:11.766161 5290 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:06:11.766251 5290 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:06:11.772244 5076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.748514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54836 (local address 127.22.49.254:44129)
0811 05:06:11.748641 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:11.748646 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:11.753576 (+ 4930us) server_negotiation.cc:407] Connection header received
0811 05:06:11.753795 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:11.753799 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:11.753851 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:11.753912 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:11.755866 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.756688 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.757905 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.758275 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.758379 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.767995 (+ 9616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:11.767999 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:11.768002 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:11.768034 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:11.769893 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.770406 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.770410 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.770413 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.770506 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.770836 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.770839 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.770841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.771120 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:11.771267 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:11.771954 (+ 687us) server_negotiation.cc:299] Negotiation successful
0811 05:06:11.772080 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 05:06:11.773757 5162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:11.749697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38950 (local address 127.22.49.253:46205)
0811 05:06:11.749825 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:11.749830 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:11.763456 (+ 13626us) server_negotiation.cc:407] Connection header received
0811 05:06:11.763502 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:11.763505 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:11.763553 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:11.763632 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:11.765939 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.766701 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.767931 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:11.768273 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:11.768399 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:11.770017 (+ 1618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:11.770021 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:11.770024 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:11.770051 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:11.771841 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.772364 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.772368 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.772370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.772456 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:11.772757 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:11.772761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:11.772763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:11.772977 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:11.773092 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:11.773486 (+ 394us) server_negotiation.cc:299] Negotiation successful
0811 05:06:11.773601 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:06:11.784727 5251 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:06:11.784917 5251 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } }
I20260811 05:06:11.786031 5251 leader_election.cc:288] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8900d24cd760443fbf0d4100f931198e (127.22.49.254:44129), 3570294747b344d98bef228ba7bfc63e (127.22.49.253:46205)
I20260811 05:06:11.789007 5041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "36e964dadcc249669e3f8f3105868db4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8900d24cd760443fbf0d4100f931198e" is_pre_election: true
I20260811 05:06:11.789427 5041 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36e964dadcc249669e3f8f3105868db4 in term 0.
I20260811 05:06:11.790066 5184 leader_election.cc:302] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36e964dadcc249669e3f8f3105868db4, 8900d24cd760443fbf0d4100f931198e; no voters:
I20260811 05:06:11.790948 5125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "36e964dadcc249669e3f8f3105868db4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3570294747b344d98bef228ba7bfc63e" is_pre_election: true
I20260811 05:06:11.791240 5125 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36e964dadcc249669e3f8f3105868db4 in term 0.
I20260811 05:06:11.792376 5251 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:06:11.792469 5251 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:06:11.792510 5251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:11.793834 5251 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } }
I20260811 05:06:11.794170 5251 leader_election.cc:288] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [CANDIDATE]: Term 1 election: Requested vote from peers 8900d24cd760443fbf0d4100f931198e (127.22.49.254:44129), 3570294747b344d98bef228ba7bfc63e (127.22.49.253:46205)
I20260811 05:06:11.794902 5125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "36e964dadcc249669e3f8f3105868db4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3570294747b344d98bef228ba7bfc63e"
I20260811 05:06:11.795051 5125 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:11.796388 5125 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36e964dadcc249669e3f8f3105868db4 in term 1.
I20260811 05:06:11.796777 5185 leader_election.cc:302] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3570294747b344d98bef228ba7bfc63e, 36e964dadcc249669e3f8f3105868db4; no voters:
I20260811 05:06:11.797048 5041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "36e964dadcc249669e3f8f3105868db4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8900d24cd760443fbf0d4100f931198e"
I20260811 05:06:11.797178 5041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:11.798475 5041 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36e964dadcc249669e3f8f3105868db4 in term 1.
I20260811 05:06:11.801376 5251 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:06:11.801674 5251 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [term 1 LEADER]: Becoming Leader. State: Replica: 36e964dadcc249669e3f8f3105868db4, State: Running, Role: LEADER
I20260811 05:06:11.802127 5251 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } }
I20260811 05:06:11.804183 5251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36e964dadcc249669e3f8f3105868db4. Latest consensus state: current_term: 1 leader_uuid: "36e964dadcc249669e3f8f3105868db4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } } }
I20260811 05:06:11.804401 5251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:11.804832 5300 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:06:11.808799 5300 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:06:11.819097 5125 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e [term 1 FOLLOWER]: Refusing update from remote peer 36e964dadcc249669e3f8f3105868db4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:06:11.819954 5298 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:06:11.824160 5252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36e964dadcc249669e3f8f3105868db4. Latest consensus state: current_term: 1 leader_uuid: "36e964dadcc249669e3f8f3105868db4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } } }
I20260811 05:06:11.824280 5252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:06:11.827711 5041 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e [term 1 FOLLOWER]: Refusing update from remote peer 36e964dadcc249669e3f8f3105868db4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:06:11.828462 5298 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:06:11.832656 5253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36e964dadcc249669e3f8f3105868db4. Latest consensus state: current_term: 1 leader_uuid: "36e964dadcc249669e3f8f3105868db4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } } }
I20260811 05:06:11.832773 5253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:06:11.837298 5298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "36e964dadcc249669e3f8f3105868db4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } } }
I20260811 05:06:11.837437 5298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:11.839644 5252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "36e964dadcc249669e3f8f3105868db4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } } }
I20260811 05:06:11.839756 5252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:06:11.840775 5301 mvcc.cc:205] Tried to move back new op lower bound from 7317195865362890752 to 7317195865305657344. Current Snapshot: MvccSnapshot[applied={T|T < 7317195865362890752}]
I20260811 05:06:11.843025 5251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "36e964dadcc249669e3f8f3105868db4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } } }
I20260811 05:06:11.843137 5251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:11.844198 5253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "36e964dadcc249669e3f8f3105868db4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8900d24cd760443fbf0d4100f931198e" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 44129 } } peers { permanent_uuid: "3570294747b344d98bef228ba7bfc63e" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 46205 } } peers { permanent_uuid: "36e964dadcc249669e3f8f3105868db4" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 34531 } } }
I20260811 05:06:11.844326 5253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:06:11.846231 5304 mvcc.cc:205] Tried to move back new op lower bound from 7317195865362890752 to 7317195865305657344. Current Snapshot: MvccSnapshot[applied={T|T < 7317195865362890752}]
I20260811 05:06:11.847236 5302 mvcc.cc:205] Tried to move back new op lower bound from 7317195865362890752 to 7317195865305657344. Current Snapshot: MvccSnapshot[applied={T|T < 7317195865362890752}]
I20260811 05:06:11.849234 5300 catalog_manager.cc:1347] Generated new cluster ID: a8f11276e56a44f188d1ef4d2cf312f0
I20260811 05:06:11.849305 5300 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:06:11.870276 5300 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:06:11.871724 5300 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:06:11.901821 5300 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36e964dadcc249669e3f8f3105868db4: Generated new TSK 0
I20260811 05:06:11.902791 5300 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:06:12.765509 5285 catalog_manager.cc:1259] Loaded cluster ID: a8f11276e56a44f188d1ef4d2cf312f0
I20260811 05:06:12.765635 5285 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e: loading cluster ID for follower catalog manager: success
I20260811 05:06:12.767436 5290 catalog_manager.cc:1259] Loaded cluster ID: a8f11276e56a44f188d1ef4d2cf312f0
I20260811 05:06:12.767498 5290 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e: loading cluster ID for follower catalog manager: success
I20260811 05:06:12.767577 5285 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e: acquiring CA information for follower catalog manager: success
I20260811 05:06:12.768762 5285 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8900d24cd760443fbf0d4100f931198e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 05:06:12.769062 5290 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e: acquiring CA information for follower catalog manager: success
I20260811 05:06:12.770037 5290 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3570294747b344d98bef228ba7bfc63e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 05:06:12.978605 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 4998
I20260811 05:06:12.987341 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 5080
I20260811 05:06:12.994961 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 5163
2026-08-11T05:06:12Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3215 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:06:13 dist-test-slave-w206 krb5kdc[5318](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:06:13 dist-test-slave-w206 krb5kdc[5318](info): set up 2 sockets
Aug 11 05:06:13 dist-test-slave-w206 krb5kdc[5318](info): commencing operation
krb5kdc: starting...
W20260811 05:06:14.124950 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:06:14 dist-test-slave-w206 krb5kdc[5318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:06:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:06:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:06:14.264217 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:38011
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:39489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:38011
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:14.377480 5332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:14.377741 5332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:14.377782 5332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:14.381819 5332 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:06:14.381877 5332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:14.381897 5332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:14.381914 5332 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:06:14.381929 5332 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:06:14.387164 5332 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:39489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:38011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:38011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:14.388163 5332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:14.389122 5332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:14.397816 5338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:14.397862 5332 server_base.cc:1034] running on GCE node
W20260811 05:06:14.397826 5340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:14.397826 5337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:14.398690 5332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:14.399835 5332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:14.401006 5332 hybrid_clock.cc:648] HybridClock initialized: now 1786424774400984 us; error 34 us; skew 500 ppm
Aug 11 05:06:14 dist-test-slave-w206 krb5kdc[5318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424774, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:14.404101 5332 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:06:14.404919 5332 webserver.cc:460] Webserver started at http://127.22.49.254:38337/ using document root <none> and password file <none>
I20260811 05:06:14.405432 5332 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:14.405489 5332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:14.405653 5332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:06:14.407727 5332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "1ab6b102a0eb4a1882713a24e3197301"
format_stamp: "Formatted at 2026-08-11 05:06:14 on dist-test-slave-w206"
server_key: "c2bc6fefe5e777f8d0521f35aa9725e9"
server_key_iv: "1d58342cdeee7b1ad49f2a4b48213b07"
server_key_version: "encryptionkey@0"
I20260811 05:06:14.408262 5332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "1ab6b102a0eb4a1882713a24e3197301"
format_stamp: "Formatted at 2026-08-11 05:06:14 on dist-test-slave-w206"
server_key: "c2bc6fefe5e777f8d0521f35aa9725e9"
server_key_iv: "1d58342cdeee7b1ad49f2a4b48213b07"
server_key_version: "encryptionkey@0"
I20260811 05:06:14.412081 5332 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 05:06:14.414510 5347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:14.415830 5332 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 05:06:14.415977 5332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "1ab6b102a0eb4a1882713a24e3197301"
format_stamp: "Formatted at 2026-08-11 05:06:14 on dist-test-slave-w206"
server_key: "c2bc6fefe5e777f8d0521f35aa9725e9"
server_key_iv: "1d58342cdeee7b1ad49f2a4b48213b07"
server_key_version: "encryptionkey@0"
I20260811 05:06:14.416098 5332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:14.440373 5332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:14.443831 5332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:14.444051 5332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:14.451571 5332 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:38011
I20260811 05:06:14.451645 5404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:38011 every 8 connection(s)
I20260811 05:06:14.452589 5332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:06:14.455402 5405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:14.460884 5405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301: Bootstrap starting.
I20260811 05:06:14.462004 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 5332
I20260811 05:06:14.462144 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:06:14.462466 22727 external_mini_cluster.cc:1428] Setting key e89645c5cfcd5dd2fa78351f80bd0fc3
I20260811 05:06:14.463912 5405 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:14.464682 5405 log.cc:824] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:14.467037 5405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301: No bootstrap required, opened a new log
Aug 11 05:06:14 dist-test-slave-w206 krb5kdc[5318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:14.471593 5405 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab6b102a0eb4a1882713a24e3197301" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 38011 } }
I20260811 05:06:14.471904 5405 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:14.471993 5405 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab6b102a0eb4a1882713a24e3197301, State: Initialized, Role: FOLLOWER
I20260811 05:06:14.472472 5405 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab6b102a0eb4a1882713a24e3197301" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 38011 } }
I20260811 05:06:14.472661 5405 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:06:14.472738 5405 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:06:14.472880 5405 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:14.474195 5405 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab6b102a0eb4a1882713a24e3197301" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 38011 } }
I20260811 05:06:14.474578 5405 leader_election.cc:302] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ab6b102a0eb4a1882713a24e3197301; no voters:
I20260811 05:06:14.474978 5405 leader_election.cc:288] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:06:14.475075 5411 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:06:14.475279 5411 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [term 1 LEADER]: Becoming Leader. State: Replica: 1ab6b102a0eb4a1882713a24e3197301, State: Running, Role: LEADER
I20260811 05:06:14.475580 5411 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab6b102a0eb4a1882713a24e3197301" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 38011 } }
I20260811 05:06:14.476310 5405 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:06:14.477815 5413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ab6b102a0eb4a1882713a24e3197301. Latest consensus state: current_term: 1 leader_uuid: "1ab6b102a0eb4a1882713a24e3197301" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab6b102a0eb4a1882713a24e3197301" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 38011 } } }
I20260811 05:06:14.478223 5413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:14.478350 5409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:14.463640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42436 (local address 127.22.49.254:38011)
0811 05:06:14.464083 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:14.464099 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:14.464137 (+ 38us) server_negotiation.cc:407] Connection header received
0811 05:06:14.464771 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:14.464786 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:14.465237 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:14.465595 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:14.466474 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:14.467575 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:14.468722 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:14.469181 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:14.469296 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:14.472387 (+ 3091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:14.472393 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:14.472409 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:14.472441 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:14.474623 (+ 2182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:14.475328 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:14.475337 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:14.475344 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:14.475528 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:14.475832 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:14.475837 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:14.475839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:14.476284 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:14.476504 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:14.476950 (+ 446us) server_negotiation.cc:299] Negotiation successful
0811 05:06:14.477296 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":141,"threads_started":1}
I20260811 05:06:14.478124 5412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ab6b102a0eb4a1882713a24e3197301" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab6b102a0eb4a1882713a24e3197301" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 38011 } } }
I20260811 05:06:14.478730 5412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:14.479188 5428 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:06:14.481410 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:06:14.482415 5428 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:06:14.488298 5428 catalog_manager.cc:1347] Generated new cluster ID: dedfac2e95ac408f9ca5d683174f4182
I20260811 05:06:14.488401 5428 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:06:14.500382 5428 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:06:14.501513 5428 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:06:14.507205 5428 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ab6b102a0eb4a1882713a24e3197301: Generated new TSK 0
I20260811 05:06:14.508064 5428 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:06:14.538123 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 5332
2026-08-11T05:06:14Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1542 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:06:14 dist-test-slave-w206 krb5kdc[5435](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:06:14 dist-test-slave-w206 krb5kdc[5435](info): set up 2 sockets
Aug 11 05:06:14 dist-test-slave-w206 krb5kdc[5435](info): commencing operation
krb5kdc: starting...
W20260811 05:06:15.626660 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:06:15 dist-test-slave-w206 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:06:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:06:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:06:15.764370 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:43503
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:43503
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:15.878360 5448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:15.878670 5448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:15.878744 5448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:15.882762 5448 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:06:15.882865 5448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:15.882906 5448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:15.882963 5448 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:06:15.883018 5448 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:06:15.888345 5448 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:43503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:43503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:15.889487 5448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:15.890542 5448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:15.899282 5454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:15.899281 5453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:15.899312 5456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:15.899501 5448 server_base.cc:1034] running on GCE node
I20260811 05:06:15.900358 5448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:15.901590 5448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:15.902801 5448 hybrid_clock.cc:648] HybridClock initialized: now 1786424775902780 us; error 32 us; skew 500 ppm
Aug 11 05:06:15 dist-test-slave-w206 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424775, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:15.914877 5448 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:06:15.916071 5448 webserver.cc:460] Webserver started at http://127.22.49.254:41473/ using document root <none> and password file <none>
I20260811 05:06:15.916731 5448 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:15.916805 5448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:15.917045 5448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:06:15.919449 5448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1"
format_stamp: "Formatted at 2026-08-11 05:06:15 on dist-test-slave-w206"
server_key: "0fceb5e7882f8d5ad592d5b5ee9f1cdb"
server_key_iv: "32adca6b1247718497dcaa7fc67aa0d3"
server_key_version: "encryptionkey@0"
I20260811 05:06:15.920104 5448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1"
format_stamp: "Formatted at 2026-08-11 05:06:15 on dist-test-slave-w206"
server_key: "0fceb5e7882f8d5ad592d5b5ee9f1cdb"
server_key_iv: "32adca6b1247718497dcaa7fc67aa0d3"
server_key_version: "encryptionkey@0"
I20260811 05:06:15.924400 5448 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260811 05:06:15.927410 5463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:15.928752 5448 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 05:06:15.928905 5448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1"
format_stamp: "Formatted at 2026-08-11 05:06:15 on dist-test-slave-w206"
server_key: "0fceb5e7882f8d5ad592d5b5ee9f1cdb"
server_key_iv: "32adca6b1247718497dcaa7fc67aa0d3"
server_key_version: "encryptionkey@0"
I20260811 05:06:15.929044 5448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:15.957991 5448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:15.961869 5448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:15.962116 5448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:15.970031 5448 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:43503
I20260811 05:06:15.970347 5519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:43503 every 8 connection(s)
I20260811 05:06:15.971163 5448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:06:15.972332 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 5448
I20260811 05:06:15.972488 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:06:15.972815 22727 external_mini_cluster.cc:1428] Setting key 25e49fcda205a770ffb8ff9fc4b536f1
I20260811 05:06:15.974570 5520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:15.981793 5520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: Bootstrap starting.
Aug 11 05:06:15 dist-test-slave-w206 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:15.984299 5520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:15.985316 5520 log.cc:824] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:15.988072 5520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: No bootstrap required, opened a new log
I20260811 05:06:15.989240 5524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:15.974339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45314 (local address 127.22.49.254:43503)
0811 05:06:15.974780 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:15.974797 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:15.975060 (+ 263us) server_negotiation.cc:407] Connection header received
0811 05:06:15.975836 (+ 776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:15.975853 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:15.976206 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:15.976494 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:15.977445 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:15.978479 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:15.979719 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:15.980217 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:15.980335 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:15.983293 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:15.983298 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:15.983312 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:15.983341 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:15.985520 (+ 2179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:15.986150 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:15.986156 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:15.986161 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:15.986339 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:15.986711 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:15.986715 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:15.986717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:15.987368 (+ 651us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:15.987568 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:15.987890 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 05:06:15.988216 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":148,"threads_started":1}
I20260811 05:06:15.991720 5520 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } }
I20260811 05:06:15.992038 5520 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:15.992103 5520 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a29c512e68e4c3a9ed0c8ea0fd2f8f1, State: Initialized, Role: FOLLOWER
I20260811 05:06:15.992559 5520 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } }
I20260811 05:06:15.992709 5520 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:06:15.992797 5520 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:06:15.992900 5520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:15.993906 5520 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } }
I20260811 05:06:15.994246 5520 leader_election.cc:302] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a29c512e68e4c3a9ed0c8ea0fd2f8f1; no voters:
I20260811 05:06:15.994573 5520 leader_election.cc:288] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:06:15.994791 5526 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:06:15.995072 5526 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 1 LEADER]: Becoming Leader. State: Replica: 9a29c512e68e4c3a9ed0c8ea0fd2f8f1, State: Running, Role: LEADER
I20260811 05:06:15.995450 5526 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } }
I20260811 05:06:15.995931 5520 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:06:15.997445 5528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a29c512e68e4c3a9ed0c8ea0fd2f8f1. Latest consensus state: current_term: 1 leader_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } } }
I20260811 05:06:15.997457 5527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } } }
I20260811 05:06:15.997649 5527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:15.997915 5528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:15.998070 5537 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:06:16.001402 5537 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:06:16.007046 5537 catalog_manager.cc:1347] Generated new cluster ID: 3dd26c3792574665bfb49bfb33028e30
I20260811 05:06:16.007153 5537 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:06:16.019205 5537 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:06:16.020576 5537 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:06:16.027555 5537 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: Generated new TSK 0
I20260811 05:06:16.028429 5537 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:06:16.062029 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43503
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:16.182128 5547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:16.182471 5547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:16.182552 5547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:16.186618 5547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:16.186724 5547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:16.186823 5547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:06:16.192301 5547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:16.193486 5547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:16.194564 5547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:16.205125 5554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:16.205137 5557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:16.205191 5547 server_base.cc:1034] running on GCE node
W20260811 05:06:16.205149 5555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:16.205760 5547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:16.206439 5547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:16.207715 5547 hybrid_clock.cc:648] HybridClock initialized: now 1786424776207704 us; error 42 us; skew 500 ppm
Aug 11 05:06:16 dist-test-slave-w206 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424776, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:16.210870 5547 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:06:16.211890 5547 webserver.cc:460] Webserver started at http://127.22.49.193:42371/ using document root <none> and password file <none>
I20260811 05:06:16.212487 5547 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:16.212584 5547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:16.212833 5547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:06:16.215299 5547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "60eb60789ed9455b8fd1a625290c62af"
format_stamp: "Formatted at 2026-08-11 05:06:16 on dist-test-slave-w206"
server_key: "6724451fc04c48dc10d6fcac3d658ab7"
server_key_iv: "39fd063ab47b701398dbd659f0369a09"
server_key_version: "encryptionkey@0"
I20260811 05:06:16.215940 5547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "60eb60789ed9455b8fd1a625290c62af"
format_stamp: "Formatted at 2026-08-11 05:06:16 on dist-test-slave-w206"
server_key: "6724451fc04c48dc10d6fcac3d658ab7"
server_key_iv: "39fd063ab47b701398dbd659f0369a09"
server_key_version: "encryptionkey@0"
I20260811 05:06:16.220182 5547 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:06:16.222913 5564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:16.224413 5547 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 05:06:16.224516 5547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "60eb60789ed9455b8fd1a625290c62af"
format_stamp: "Formatted at 2026-08-11 05:06:16 on dist-test-slave-w206"
server_key: "6724451fc04c48dc10d6fcac3d658ab7"
server_key_iv: "39fd063ab47b701398dbd659f0369a09"
server_key_version: "encryptionkey@0"
I20260811 05:06:16.224655 5547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:16.245922 5547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:16.249389 5547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:16.249598 5547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:16.250227 5547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:16.251149 5547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:16.251199 5547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:16.251355 5547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:16.251389 5547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:16.260888 5547 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:42861
I20260811 05:06:16.260910 5684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:42861 every 8 connection(s)
I20260811 05:06:16.261839 5547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:06:16.270618 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 5547
I20260811 05:06:16.270763 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:06:16.271173 22727 external_mini_cluster.cc:1428] Setting key 4d0e6f35ea6662f63afcd686174fa09d
Aug 11 05:06:16 dist-test-slave-w206 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424776, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:16.276585 5524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.263822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:40795 (local address 127.22.49.254:43503)
0811 05:06:16.263984 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:16.263988 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:16.264763 (+ 775us) server_negotiation.cc:407] Connection header received
0811 05:06:16.266113 (+ 1350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:16.266116 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:16.266165 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:16.266240 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:16.267504 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.268076 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.269169 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.269407 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.269486 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.272374 (+ 2888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:16.272378 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:16.272380 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:16.272404 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:16.274024 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:16.274671 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:16.274674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:16.274675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:16.274753 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:16.275232 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:16.275237 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:16.275240 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:16.275513 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:16.275625 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:16.276138 (+ 513us) server_negotiation.cc:299] Negotiation successful
0811 05:06:16.276342 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 05:06:16.277169 5687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.264168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:40795)
0811 05:06:16.264599 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:16.264642 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:16.265894 (+ 1252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:16.266402 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:16.266408 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:16.266782 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:16.267343 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.267356 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.268190 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.268192 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.269047 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.269056 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.269544 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.269547 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.269691 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.270252 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:16.270269 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:16.272205 (+ 1936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:16.274149 (+ 1944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:16.274158 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:16.274178 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:16.274568 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:16.274893 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:16.274899 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:16.274903 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:16.275139 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:16.275622 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:16.275626 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:16.275863 (+ 237us) client_negotiation.cc:769] Sending connection context
0811 05:06:16.276039 (+ 176us) client_negotiation.cc:240] Negotiation successful
0811 05:06:16.276300 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":112,"threads_started":1}
I20260811 05:06:16.278517 5685 heartbeater.cc:347] Connected to a master server at 127.22.49.254:43503
I20260811 05:06:16.278772 5685 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:16.279331 5685 heartbeater.cc:511] Master 127.22.49.254:43503 requested a full tablet report, sending...
I20260811 05:06:16.280851 5480 ts_manager.cc:194] Registered new tserver with Master: 60eb60789ed9455b8fd1a625290c62af (127.22.49.193:42861)
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:06:16.282025 5480 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:40795
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:06:16.301693 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43503
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:16.416430 5691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:16.416723 5691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:16.416769 5691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:16.421052 5691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:16.421124 5691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:16.421185 5691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:06:16.426812 5691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:16.428128 5691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:16.429292 5691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:16.439599 5696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:16.439630 5697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:16.439599 5700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:16.439988 5691 server_base.cc:1034] running on GCE node
I20260811 05:06:16.440503 5691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:16.441203 5691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:16.442379 5691 hybrid_clock.cc:648] HybridClock initialized: now 1786424776442346 us; error 47 us; skew 500 ppm
Aug 11 05:06:16 dist-test-slave-w206 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424776, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:16.445284 5691 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:06:16.446244 5691 webserver.cc:460] Webserver started at http://127.22.49.194:40901/ using document root <none> and password file <none>
I20260811 05:06:16.446839 5691 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:16.446935 5691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:16.447198 5691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:06:16.449308 5691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "b5dc51277f924a74b1bd7e65696d3d0f"
format_stamp: "Formatted at 2026-08-11 05:06:16 on dist-test-slave-w206"
server_key: "042dabd7e052b039058109fe13227b7a"
server_key_iv: "73e0f9c8f61e90a6158cf3dfe36376cb"
server_key_version: "encryptionkey@0"
I20260811 05:06:16.449900 5691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "b5dc51277f924a74b1bd7e65696d3d0f"
format_stamp: "Formatted at 2026-08-11 05:06:16 on dist-test-slave-w206"
server_key: "042dabd7e052b039058109fe13227b7a"
server_key_iv: "73e0f9c8f61e90a6158cf3dfe36376cb"
server_key_version: "encryptionkey@0"
I20260811 05:06:16.453843 5691 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 05:06:16.456439 5707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:16.457872 5691 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 05:06:16.458052 5691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "b5dc51277f924a74b1bd7e65696d3d0f"
format_stamp: "Formatted at 2026-08-11 05:06:16 on dist-test-slave-w206"
server_key: "042dabd7e052b039058109fe13227b7a"
server_key_iv: "73e0f9c8f61e90a6158cf3dfe36376cb"
server_key_version: "encryptionkey@0"
I20260811 05:06:16.458178 5691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:16.472697 5691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:16.476012 5691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:16.476222 5691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:16.476817 5691 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:16.477639 5691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:16.477710 5691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:16.477782 5691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:16.477838 5691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:16.487545 5691 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:35939
I20260811 05:06:16.487563 5831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:35939 every 8 connection(s)
I20260811 05:06:16.488552 5691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:06:16.489446 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 5691
I20260811 05:06:16.489571 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:06:16.489954 22727 external_mini_cluster.cc:1428] Setting key 2e0781fdca789a132fab23d439085150
Aug 11 05:06:16 dist-test-slave-w206 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424776, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
I20260811 05:06:16.506311 5524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.490778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:51953 (local address 127.22.49.254:43503)
0811 05:06:16.490920 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:16.490925 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:16.492014 (+ 1089us) server_negotiation.cc:407] Connection header received
0811 05:06:16.494085 (+ 2071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:16.494088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:16.494149 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:16.494229 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:16.495746 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.496748 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.498853 (+ 2105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.499151 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.499242 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.502322 (+ 3080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:16.502325 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:16.502327 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:16.502355 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:16.503870 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:16.504504 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:16.504507 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:16.504508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:16.504595 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:16.505023 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:16.505026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:16.505028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:16.505240 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:16.505425 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:16.505969 (+ 544us) server_negotiation.cc:299] Negotiation successful
0811 05:06:16.506123 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 05:06:16.507326 5834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.491303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:51953)
0811 05:06:16.491813 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:16.491876 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:16.493793 (+ 1917us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:16.494420 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:16.494427 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:16.494801 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:16.495519 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.495545 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.496937 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.496940 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.498688 (+ 1748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.498704 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.499337 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.499344 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.499585 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.500289 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:16.500326 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:16.502157 (+ 1831us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:16.504003 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:16.504008 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:16.504022 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:16.504378 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:16.504696 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:16.504699 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:16.504700 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:16.504912 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:16.505423 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:16.505429 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:16.505701 (+ 272us) client_negotiation.cc:769] Sending connection context
0811 05:06:16.505921 (+ 220us) client_negotiation.cc:240] Negotiation successful
0811 05:06:16.506290 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":117,"threads_started":1}
I20260811 05:06:16.508550 5832 heartbeater.cc:347] Connected to a master server at 127.22.49.254:43503
I20260811 05:06:16.508821 5832 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:16.509344 5832 heartbeater.cc:511] Master 127.22.49.254:43503 requested a full tablet report, sending...
I20260811 05:06:16.510560 5480 ts_manager.cc:194] Registered new tserver with Master: b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939)
I20260811 05:06:16.511235 5480 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:51953
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:06:16.523413 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43503
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:16.637411 5837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:16.637683 5837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:16.637758 5837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:16.642318 5837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:16.642396 5837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:16.642490 5837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:06:16.647715 5837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:43503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:16.648754 5837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:16.649749 5837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:16.659310 5843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:16.659379 5846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:16.659335 5844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:16.659535 5837 server_base.cc:1034] running on GCE node
I20260811 05:06:16.660070 5837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:16.660746 5837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:16.661911 5837 hybrid_clock.cc:648] HybridClock initialized: now 1786424776661876 us; error 41 us; skew 500 ppm
Aug 11 05:06:16 dist-test-slave-w206 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424776, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:16.664915 5837 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:06:16.665843 5837 webserver.cc:460] Webserver started at http://127.22.49.195:46697/ using document root <none> and password file <none>
I20260811 05:06:16.666400 5837 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:16.666489 5837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:16.666718 5837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:06:16.668780 5837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "a098372413484f1fb1d56e3735fa3898"
format_stamp: "Formatted at 2026-08-11 05:06:16 on dist-test-slave-w206"
server_key: "b3ff79a8a1d57924e0c0b015473916d3"
server_key_iv: "43c6d5419e112b65cbbf5aad8a26c4c3"
server_key_version: "encryptionkey@0"
I20260811 05:06:16.669349 5837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "a098372413484f1fb1d56e3735fa3898"
format_stamp: "Formatted at 2026-08-11 05:06:16 on dist-test-slave-w206"
server_key: "b3ff79a8a1d57924e0c0b015473916d3"
server_key_iv: "43c6d5419e112b65cbbf5aad8a26c4c3"
server_key_version: "encryptionkey@0"
I20260811 05:06:16.673245 5837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:06:16.675812 5854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:16.676990 5837 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:06:16.677126 5837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "a098372413484f1fb1d56e3735fa3898"
format_stamp: "Formatted at 2026-08-11 05:06:16 on dist-test-slave-w206"
server_key: "b3ff79a8a1d57924e0c0b015473916d3"
server_key_iv: "43c6d5419e112b65cbbf5aad8a26c4c3"
server_key_version: "encryptionkey@0"
I20260811 05:06:16.677237 5837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:16.689252 5837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:16.692471 5837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:16.692679 5837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:16.693292 5837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:16.694137 5837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:16.694208 5837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:16.694290 5837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:16.694344 5837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:16.704193 5837 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:37423
I20260811 05:06:16.704212 5979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:37423 every 8 connection(s)
I20260811 05:06:16.705096 5837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:06:16.711565 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 5837
I20260811 05:06:16.711706 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:06:16.712026 22727 external_mini_cluster.cc:1428] Setting key 99d553828bff530ecaea9a3f6d133cf9
Aug 11 05:06:16 dist-test-slave-w206 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424776, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:16.719920 5524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.707078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:41611 (local address 127.22.49.254:43503)
0811 05:06:16.707253 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:16.707259 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:16.708170 (+ 911us) server_negotiation.cc:407] Connection header received
0811 05:06:16.709621 (+ 1451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:16.709625 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:16.709681 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:16.709780 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:16.711022 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.711589 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.713112 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.713455 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.713588 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.716389 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:16.716392 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:16.716395 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:16.716427 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:16.717784 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:16.718314 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:16.718318 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:16.718320 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:16.718411 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:16.718758 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:16.718761 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:16.718763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:16.718953 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:16.719104 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:16.719613 (+ 509us) server_negotiation.cc:299] Negotiation successful
0811 05:06:16.719748 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 05:06:16.720718 5982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.707487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:41611)
0811 05:06:16.707976 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:16.708020 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:16.709398 (+ 1378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:16.709953 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:16.709960 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:16.710373 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:16.710849 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.710862 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.711771 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.711774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.712985 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.712995 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.713629 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.713633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.713862 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.714565 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:16.714588 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:16.716215 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:16.717914 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:16.717920 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:16.717936 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:16.718202 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:16.718508 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:16.718512 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:16.718514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:16.718656 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:16.719113 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:16.719121 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:16.719367 (+ 246us) client_negotiation.cc:769] Sending connection context
0811 05:06:16.719560 (+ 193us) client_negotiation.cc:240] Negotiation successful
0811 05:06:16.719895 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":120,"threads_started":1}
I20260811 05:06:16.721890 5980 heartbeater.cc:347] Connected to a master server at 127.22.49.254:43503
I20260811 05:06:16.722164 5980 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:16.722688 5980 heartbeater.cc:511] Master 127.22.49.254:43503 requested a full tablet report, sending...
I20260811 05:06:16.723758 5480 ts_manager.cc:194] Registered new tserver with Master: a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423)
I20260811 05:06:16.724283 5480 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:41611
I20260811 05:06:16.726436 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:06:16.736271 5524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.728472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45318 (local address 127.22.49.254:43503)
0811 05:06:16.728616 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:16.728620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:16.728881 (+ 261us) server_negotiation.cc:407] Connection header received
0811 05:06:16.728924 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:16.728926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:16.728964 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:16.729034 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:16.729722 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.730231 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.731128 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.731338 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.731423 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.732901 (+ 1478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:16.732904 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:16.732906 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:16.732927 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:16.734477 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:16.734945 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:16.734948 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:16.734949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:16.735093 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:16.735417 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:16.735419 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:16.735420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:16.735635 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:16.735736 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:16.735960 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 05:06:16.736053 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 05:06:16.739280 5480 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45318:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:06:16.742381 5480 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:06:16.757416 5992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.751106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:35939 (local address 127.0.0.1:52280)
0811 05:06:16.752321 (+ 1215us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:16.752374 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:16.752623 (+ 249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:16.753233 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:16.753242 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:16.753269 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:16.753426 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.753434 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.754614 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.754618 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.755892 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.755902 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.756858 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.756862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.756968 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.757008 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 05:06:16.757120 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 05:06:16.757236 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1030,"mutex_wait_us":1,"spinlock_wait_cycles":2304,"thread_start_us":110,"threads_started":1}
I20260811 05:06:16.757483 5995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.751372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52280 (local address 127.22.49.194:35939)
0811 05:06:16.751827 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:16.751840 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:16.752487 (+ 647us) server_negotiation.cc:407] Connection header received
0811 05:06:16.752823 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:16.752830 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:16.753051 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:16.753219 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:16.753560 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.754468 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.756039 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.756719 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.756844 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.756997 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:16.757186 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 05:06:16.757291 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":129,"threads_started":1}
I20260811 05:06:16.758128 5996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.751338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:42861 (local address 127.0.0.1:37640)
0811 05:06:16.752454 (+ 1116us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:16.752471 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:16.752623 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:16.753521 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:16.753524 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:16.753546 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:16.753647 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.753652 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.755102 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.755106 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.756428 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.756440 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.757699 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.757703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.757792 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.757810 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 05:06:16.757910 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 05:06:16.757982 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":908,"mutex_wait_us":68,"spinlock_wait_cycles":3840,"thread_start_us":102,"threads_started":1}
I20260811 05:06:16.758630 5994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.751851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:37423 (local address 127.0.0.1:42060)
0811 05:06:16.752769 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:16.752783 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:16.752857 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:16.753581 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:16.753584 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:16.753606 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:16.753805 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.753814 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.755204 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.755207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.756435 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.756441 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.757982 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.757986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.758104 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.758145 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 05:06:16.758386 (+ 241us) client_negotiation.cc:240] Negotiation successful
0811 05:06:16.758468 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":855,"mutex_wait_us":96,"thread_start_us":132,"threads_started":1}
I20260811 05:06:16.758834 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.752105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37640 (local address 127.22.49.193:42861)
0811 05:06:16.752594 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:16.752610 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:16.752633 (+ 23us) server_negotiation.cc:407] Connection header received
0811 05:06:16.752988 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:16.752993 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:16.753169 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:16.753324 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:16.753760 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.754919 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.756580 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.757312 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.757406 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.757548 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:16.758494 (+ 946us) server_negotiation.cc:299] Negotiation successful
0811 05:06:16.758592 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":94,"threads_started":1}
I20260811 05:06:16.759158 5998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.752108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42060 (local address 127.22.49.195:37423)
0811 05:06:16.752958 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:16.752972 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:16.752995 (+ 23us) server_negotiation.cc:407] Connection header received
0811 05:06:16.753068 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:16.753073 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:16.753249 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:16.753395 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:16.753948 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.755073 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.756575 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.757402 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.757751 (+ 349us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.757908 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:16.758820 (+ 912us) server_negotiation.cc:299] Negotiation successful
0811 05:06:16.758941 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":750,"thread_start_us":173,"threads_started":1}
I20260811 05:06:16.760886 5759 tablet_service.cc:1467] Processing CreateTablet for tablet f404283fe18c4002a5c39218354b8723 (DEFAULT_TABLE table=test-table [id=deef9c703b7d4a8d85740b02e8b8faf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:06:16.761507 5613 tablet_service.cc:1467] Processing CreateTablet for tablet f404283fe18c4002a5c39218354b8723 (DEFAULT_TABLE table=test-table [id=deef9c703b7d4a8d85740b02e8b8faf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:06:16.761690 5906 tablet_service.cc:1467] Processing CreateTablet for tablet f404283fe18c4002a5c39218354b8723 (DEFAULT_TABLE table=test-table [id=deef9c703b7d4a8d85740b02e8b8faf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:06:16.762112 5759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f404283fe18c4002a5c39218354b8723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:16.762588 5613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f404283fe18c4002a5c39218354b8723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:16.762648 5906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f404283fe18c4002a5c39218354b8723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:16.768870 5999 tablet_bootstrap.cc:492] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: Bootstrap starting.
I20260811 05:06:16.769989 6000 tablet_bootstrap.cc:492] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f: Bootstrap starting.
I20260811 05:06:16.770300 6001 tablet_bootstrap.cc:492] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898: Bootstrap starting.
I20260811 05:06:16.771688 5999 tablet_bootstrap.cc:654] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:16.772190 6000 tablet_bootstrap.cc:654] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:16.772452 6001 tablet_bootstrap.cc:654] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:16.773156 5999 log.cc:824] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:16.773983 6001 log.cc:824] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:16.774848 6000 log.cc:824] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:16.775533 5999 tablet_bootstrap.cc:492] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: No bootstrap required, opened a new log
I20260811 05:06:16.775763 5999 ts_tablet_manager.cc:1397] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 05:06:16.776446 6001 tablet_bootstrap.cc:492] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898: No bootstrap required, opened a new log
I20260811 05:06:16.776630 6001 ts_tablet_manager.cc:1397] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 05:06:16.776754 6000 tablet_bootstrap.cc:492] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f: No bootstrap required, opened a new log
I20260811 05:06:16.776929 6000 ts_tablet_manager.cc:1397] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 05:06:16.778945 5999 raft_consensus.cc:348] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } } peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } }
I20260811 05:06:16.779325 5999 raft_consensus.cc:374] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:16.779418 5999 raft_consensus.cc:729] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60eb60789ed9455b8fd1a625290c62af, State: Initialized, Role: FOLLOWER
I20260811 05:06:16.779947 5999 consensus_queue.cc:260] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } } peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } }
I20260811 05:06:16.780468 6001 raft_consensus.cc:348] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } } peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } }
I20260811 05:06:16.780727 6001 raft_consensus.cc:374] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:16.780584 6000 raft_consensus.cc:348] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } } peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } }
I20260811 05:06:16.780797 6000 raft_consensus.cc:374] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:16.780869 6000 raft_consensus.cc:729] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5dc51277f924a74b1bd7e65696d3d0f, State: Initialized, Role: FOLLOWER
I20260811 05:06:16.780884 6001 raft_consensus.cc:729] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a098372413484f1fb1d56e3735fa3898, State: Initialized, Role: FOLLOWER
I20260811 05:06:16.781080 5999 ts_tablet_manager.cc:1428] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 05:06:16.781304 6000 consensus_queue.cc:260] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } } peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } }
I20260811 05:06:16.781304 6001 consensus_queue.cc:260] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } } peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } }
I20260811 05:06:16.781451 5685 heartbeater.cc:503] Master 127.22.49.254:43503 was elected leader, sending a full tablet report...
I20260811 05:06:16.781948 5832 heartbeater.cc:503] Master 127.22.49.254:43503 was elected leader, sending a full tablet report...
I20260811 05:06:16.782192 6001 ts_tablet_manager.cc:1428] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 05:06:16.782192 6000 ts_tablet_manager.cc:1428] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 05:06:16.782493 5980 heartbeater.cc:503] Master 127.22.49.254:43503 was elected leader, sending a full tablet report...
I20260811 05:06:16.784224 6006 raft_consensus.cc:482] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:06:16.784458 6006 raft_consensus.cc:504] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } } peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } }
I20260811 05:06:16.785703 6006 leader_election.cc:288] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939), a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423)
I20260811 05:06:16.791370 5995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.786749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:55909 (local address 127.22.49.194:35939)
0811 05:06:16.786852 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:16.786858 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:16.786874 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:06:16.786918 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:16.786920 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:16.786960 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:16.787060 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:16.787384 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.788171 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.790393 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.790774 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.790921 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.790991 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:16.791194 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 05:06:16.791261 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 05:06:16.791438 6009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.785929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:35939 (local address 127.22.49.193:55909)
0811 05:06:16.786201 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:16.786215 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:16.786297 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:16.787079 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:16.787082 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:16.787100 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:16.787250 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.787257 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.788397 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.788401 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.790251 (+ 1850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.790263 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.790915 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.790919 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.791052 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.791082 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 05:06:16.791168 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 05:06:16.791244 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":185,"thread_start_us":106,"threads_started":1}
I20260811 05:06:16.791536 5998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.786748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:55219 (local address 127.22.49.195:37423)
0811 05:06:16.786869 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:16.786874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:16.786889 (+ 15us) server_negotiation.cc:407] Connection header received
0811 05:06:16.786926 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:16.786929 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:16.787020 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:16.787078 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:16.787523 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.788255 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.790428 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.790881 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.791048 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.791101 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:16.791343 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 05:06:16.791417 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 05:06:16.791800 6010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.786315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:37423 (local address 127.22.49.193:55219)
0811 05:06:16.786598 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:16.786610 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:16.786722 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:16.787224 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:16.787228 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:16.787243 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:16.787405 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.787413 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.788397 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.788401 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.790251 (+ 1850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:16.790263 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.791054 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.791058 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:16.791187 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.791214 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 05:06:16.791326 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 05:06:16.791404 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":241,"thread_start_us":116,"threads_started":1}
I20260811 05:06:16.791975 5782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f404283fe18c4002a5c39218354b8723" candidate_uuid: "60eb60789ed9455b8fd1a625290c62af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" is_pre_election: true
I20260811 05:06:16.792306 5782 raft_consensus.cc:2454] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60eb60789ed9455b8fd1a625290c62af in term 0.
I20260811 05:06:16.792366 5929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f404283fe18c4002a5c39218354b8723" candidate_uuid: "60eb60789ed9455b8fd1a625290c62af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a098372413484f1fb1d56e3735fa3898" is_pre_election: true
I20260811 05:06:16.792611 5929 raft_consensus.cc:2454] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60eb60789ed9455b8fd1a625290c62af in term 0.
I20260811 05:06:16.792827 5567 leader_election.cc:302] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60eb60789ed9455b8fd1a625290c62af, b5dc51277f924a74b1bd7e65696d3d0f; no voters:
I20260811 05:06:16.793129 6006 raft_consensus.cc:2781] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:06:16.793205 6006 raft_consensus.cc:482] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:06:16.793236 6006 raft_consensus.cc:3037] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:16.794255 6006 raft_consensus.cc:504] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } } peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } }
I20260811 05:06:16.794584 6006 leader_election.cc:288] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 1 election: Requested vote from peers b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939), a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423)
I20260811 05:06:16.795023 5782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f404283fe18c4002a5c39218354b8723" candidate_uuid: "60eb60789ed9455b8fd1a625290c62af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5dc51277f924a74b1bd7e65696d3d0f"
I20260811 05:06:16.795145 5782 raft_consensus.cc:3037] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:16.795099 5929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f404283fe18c4002a5c39218354b8723" candidate_uuid: "60eb60789ed9455b8fd1a625290c62af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a098372413484f1fb1d56e3735fa3898"
I20260811 05:06:16.795245 5929 raft_consensus.cc:3037] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:16.796227 5782 raft_consensus.cc:2454] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60eb60789ed9455b8fd1a625290c62af in term 1.
I20260811 05:06:16.796499 5567 leader_election.cc:302] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60eb60789ed9455b8fd1a625290c62af, b5dc51277f924a74b1bd7e65696d3d0f; no voters:
I20260811 05:06:16.796543 5929 raft_consensus.cc:2454] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60eb60789ed9455b8fd1a625290c62af in term 1.
I20260811 05:06:16.796725 6006 raft_consensus.cc:2781] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:06:16.797042 6006 raft_consensus.cc:686] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 1 LEADER]: Becoming Leader. State: Replica: 60eb60789ed9455b8fd1a625290c62af, State: Running, Role: LEADER
I20260811 05:06:16.797452 6006 consensus_queue.cc:237] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } } peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } }
I20260811 05:06:16.800571 5479 catalog_manager.cc:5495] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af reported cstate change: term changed from 0 to 1, leader changed from <none> to 60eb60789ed9455b8fd1a625290c62af (127.22.49.193). New cstate: current_term: 1 leader_uuid: "60eb60789ed9455b8fd1a625290c62af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } health_report { overall_health: UNKNOWN } } }
I20260811 05:06:16.820297 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.816626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37654 (local address 127.22.49.193:42861)
0811 05:06:16.816777 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:16.816782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:16.816798 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:06:16.816959 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:16.816962 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:16.817018 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:16.817130 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:06:16.817394 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.817911 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.818791 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:16.819046 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:16.819160 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:16.819482 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:06:16.819895 (+ 413us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:06:16.820047 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:16.820091 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 05:06:16.820149 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 05:06:16.826190 5929 raft_consensus.cc:1261] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898 [term 1 FOLLOWER]: Refusing update from remote peer 60eb60789ed9455b8fd1a625290c62af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:06:16.826191 5782 raft_consensus.cc:1261] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f [term 1 FOLLOWER]: Refusing update from remote peer 60eb60789ed9455b8fd1a625290c62af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:06:16.827009 6006 consensus_queue.cc:1035] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:06:16.827250 6011 consensus_queue.cc:1035] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:06:16.836182 6016 mvcc.cc:205] Tried to move back new op lower bound from 7317195885872312320 to 7317195885764931584. Current Snapshot: MvccSnapshot[applied={T|T < 7317195885872312320}]
I20260811 05:06:16.837371 6017 mvcc.cc:205] Tried to move back new op lower bound from 7317195885872312320 to 7317195885764931584. Current Snapshot: MvccSnapshot[applied={T|T < 7317195885872312320}]
I20260811 05:06:16.842442 5479 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45318:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:06:16.842618 5479 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45318:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:06:16.845026 5479 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: Sending DeleteTablet for 3 replicas of tablet f404283fe18c4002a5c39218354b8723
I20260811 05:06:16.845786 5613 tablet_service.cc:1514] Processing DeleteTablet for tablet f404283fe18c4002a5c39218354b8723 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:16 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:37640
I20260811 05:06:16.845885 5906 tablet_service.cc:1514] Processing DeleteTablet for tablet f404283fe18c4002a5c39218354b8723 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:16 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:42060
I20260811 05:06:16.846318 6024 tablet_replica.cc:330] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: stopping tablet replica
I20260811 05:06:16.846349 5759 tablet_service.cc:1514] Processing DeleteTablet for tablet f404283fe18c4002a5c39218354b8723 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:16 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:52280
I20260811 05:06:16.846669 6024 raft_consensus.cc:2229] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:06:16.846791 6026 tablet_replica.cc:330] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f: stopping tablet replica
I20260811 05:06:16.846866 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 5547
I20260811 05:06:16.847153 6024 raft_consensus.cc:2258] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:06:16.848224 6026 raft_consensus.cc:2229] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:06:16.848533 6026 raft_consensus.cc:2258] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:06:16.850209 6026 ts_tablet_manager.cc:1905] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:06:16.852620 6026 ts_tablet_manager.cc:1918] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:06:16.852705 6026 log.cc:1196] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/f404283fe18c4002a5c39218354b8723
I20260811 05:06:16.853027 6025 tablet_replica.cc:330] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898: stopping tablet replica
I20260811 05:06:16.853076 6026 ts_tablet_manager.cc:1939] T f404283fe18c4002a5c39218354b8723 P b5dc51277f924a74b1bd7e65696d3d0f: Deleting consensus metadata
I20260811 05:06:16.853375 6025 raft_consensus.cc:2229] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:06:16.853681 6025 raft_consensus.cc:2258] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:06:16.854388 5466 catalog_manager.cc:4841] TS b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939): tablet f404283fe18c4002a5c39218354b8723 (table test-table [id=deef9c703b7d4a8d85740b02e8b8faf5]) successfully deleted
I20260811 05:06:16.855216 6025 ts_tablet_manager.cc:1905] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 05:06:16.856998 5467 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:42861 (error 108)
I20260811 05:06:16.857564 6025 ts_tablet_manager.cc:1918] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:06:16.857601 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 5691
I20260811 05:06:16.857693 6025 log.cc:1196] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/f404283fe18c4002a5c39218354b8723
I20260811 05:06:16.858234 5994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:16.857807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:42861 (local address 127.0.0.1:37656)
0811 05:06:16.858055 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:16.858138 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:42861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
W20260811 05:06:16.858388 5467 catalog_manager.cc:4584] TS 60eb60789ed9455b8fd1a625290c62af (127.22.49.193:42861): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f404283fe18c4002a5c39218354b8723: Network error: Client connection negotiation failed: client connection to 127.22.49.193:42861: connect: Connection refused (error 111)
I20260811 05:06:16.858050 6025 ts_tablet_manager.cc:1939] T f404283fe18c4002a5c39218354b8723 P a098372413484f1fb1d56e3735fa3898: Deleting consensus metadata
I20260811 05:06:16.859645 5466 catalog_manager.cc:4841] TS a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423): tablet f404283fe18c4002a5c39218354b8723 (table test-table [id=deef9c703b7d4a8d85740b02e8b8faf5]) successfully deleted
I20260811 05:06:16.865908 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 5837
I20260811 05:06:16.872128 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 5448
I20260811 05:06:16.880503 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:43503
--webserver_interface=127.22.49.254
--webserver_port=41473
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:43503
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:16.991958 6028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:16.992241 6028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:16.992316 6028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:16.996387 6028 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:06:16.996456 6028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:16.996475 6028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:16.996492 6028 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:06:16.996508 6028 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:06:17.001919 6028 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:43503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:43503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=41473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:17.003127 6028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:17.004171 6028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:17.018350 6037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:17.018433 6035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:17.018424 6034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:17.018687 6028 server_base.cc:1034] running on GCE node
I20260811 05:06:17.019477 6028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:17.020704 6028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:17.021905 6028 hybrid_clock.cc:648] HybridClock initialized: now 1786424777021889 us; error 27 us; skew 500 ppm
Aug 11 05:06:17 dist-test-slave-w206 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424777, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:17.025274 6028 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:06:17.026293 6028 webserver.cc:460] Webserver started at http://127.22.49.254:41473/ using document root <none> and password file <none>
I20260811 05:06:17.026918 6028 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:17.027068 6028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:17.030969 6028 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:06:17.033360 6047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:17.034761 6028 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:06:17.034936 6028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1"
format_stamp: "Formatted at 2026-08-11 05:06:15 on dist-test-slave-w206"
server_key: "0fceb5e7882f8d5ad592d5b5ee9f1cdb"
server_key_iv: "32adca6b1247718497dcaa7fc67aa0d3"
server_key_version: "encryptionkey@0"
I20260811 05:06:17.035651 6028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:17.050506 6028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:17.053560 6028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:17.053769 6028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:17.061319 6028 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:43503
I20260811 05:06:17.061646 6105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:43503 every 8 connection(s)
I20260811 05:06:17.062474 6028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:06:17.067049 6106 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:06:17.067723 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 6028
I20260811 05:06:17.068264 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:42861
--local_ip_for_outbound_sockets=127.22.49.193
--tserver_master_addrs=127.22.49.254:43503
--webserver_port=42371
--webserver_interface=127.22.49.193
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:06:17.069346 6106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: Bootstrap starting.
I20260811 05:06:17.087216 6106 log.cc:824] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:17.098026 6106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:06:17.098498 6106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: Bootstrap complete.
I20260811 05:06:17.102867 6106 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } }
I20260811 05:06:17.103391 6106 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a29c512e68e4c3a9ed0c8ea0fd2f8f1, State: Initialized, Role: FOLLOWER
I20260811 05:06:17.103968 6106 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } }
I20260811 05:06:17.104120 6106 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:06:17.104192 6106 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:06:17.104326 6106 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 1 FOLLOWER]: Advancing to term 2
I20260811 05:06:17.106271 6106 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } }
I20260811 05:06:17.106622 6106 leader_election.cc:302] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a29c512e68e4c3a9ed0c8ea0fd2f8f1; no voters:
I20260811 05:06:17.107002 6106 leader_election.cc:288] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 05:06:17.107151 6110 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 05:06:17.107432 6110 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 2 LEADER]: Becoming Leader. State: Replica: 9a29c512e68e4c3a9ed0c8ea0fd2f8f1, State: Running, Role: LEADER
I20260811 05:06:17.107769 6110 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } }
I20260811 05:06:17.108292 6106 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:06:17.108870 6110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a29c512e68e4c3a9ed0c8ea0fd2f8f1. Latest consensus state: current_term: 2 leader_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } } }
I20260811 05:06:17.109112 6110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:17.109272 6111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } } }
I20260811 05:06:17.109391 6111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:17.109649 6117 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:06:17.114993 6117 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:06:17.115749 6117 catalog_manager.cc:1259] Loaded cluster ID: 3dd26c3792574665bfb49bfb33028e30
I20260811 05:06:17.115873 6117 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:06:17.117525 6117 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 05:06:17.123103 6117 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 05:06:17.130105 6117 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:06:17.131157 6117 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: Loaded TSK: 0
I20260811 05:06:17.132586 6117 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 05:06:17.219378 6108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:17.219745 6108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:17.219811 6108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:17.225804 6108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:17.225898 6108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:17.225989 6108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:06:17.233696 6108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:42861
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=42371
--tserver_master_addrs=127.22.49.254:43503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:17.235102 6108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:17.236384 6108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:17.247272 6134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:17.247344 6133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:17.247299 6136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:17.247876 6108 server_base.cc:1034] running on GCE node
I20260811 05:06:17.248308 6108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:17.249037 6108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:17.250245 6108 hybrid_clock.cc:648] HybridClock initialized: now 1786424777250207 us; error 41 us; skew 500 ppm
Aug 11 05:06:17 dist-test-slave-w206 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424777, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:17.253721 6108 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:06:17.254863 6108 webserver.cc:460] Webserver started at http://127.22.49.193:42371/ using document root <none> and password file <none>
I20260811 05:06:17.255600 6108 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:17.255710 6108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:17.260802 6108 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.001s
I20260811 05:06:17.263564 6144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:17.265085 6108 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:06:17.265216 6108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "60eb60789ed9455b8fd1a625290c62af"
format_stamp: "Formatted at 2026-08-11 05:06:16 on dist-test-slave-w206"
server_key: "6724451fc04c48dc10d6fcac3d658ab7"
server_key_iv: "39fd063ab47b701398dbd659f0369a09"
server_key_version: "encryptionkey@0"
I20260811 05:06:17.265937 6108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:17.288051 6108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:17.291810 6108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:17.292011 6108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:17.292706 6108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:17.294085 6151 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 05:06:17.298735 6108 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 05:06:17.298816 6108 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.001s
I20260811 05:06:17.298898 6108 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 05:06:17.301190 6108 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 05:06:17.301259 6108 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 05:06:17.301604 6151 tablet_bootstrap.cc:492] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: Bootstrap starting.
I20260811 05:06:17.311406 6108 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:42861
I20260811 05:06:17.311564 6264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:42861 every 8 connection(s)
I20260811 05:06:17.312510 6108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:06:17.317783 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 6108
I20260811 05:06:17.318320 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:35939
--local_ip_for_outbound_sockets=127.22.49.194
--tserver_master_addrs=127.22.49.254:43503
--webserver_port=40901
--webserver_interface=127.22.49.194
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:06:17.324874 6151 log.cc:824] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: Log is configured to *not* fsync() on all Append() calls
Aug 11 05:06:17 dist-test-slave-w206 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424777, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:17.333178 6151 tablet_bootstrap.cc:492] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:06:17.333631 6151 tablet_bootstrap.cc:492] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: Bootstrap complete.
I20260811 05:06:17.333895 6268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.314794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:60103)
0811 05:06:17.315971 (+ 1177us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:17.316025 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:17.316959 (+ 934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:17.318595 (+ 1636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:17.318605 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:17.319151 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:17.319825 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.319843 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.321725 (+ 1882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.321729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.323328 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.323341 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.324314 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.324321 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.324573 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.325355 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:17.325383 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:17.327452 (+ 2069us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:17.330360 (+ 2908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:17.330366 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:17.330379 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:17.330722 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:17.331209 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:17.331213 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:17.331215 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:17.331373 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:17.332120 (+ 747us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:17.332127 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:17.332389 (+ 262us) client_negotiation.cc:769] Sending connection context
0811 05:06:17.332571 (+ 182us) client_negotiation.cc:240] Negotiation successful
0811 05:06:17.332900 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":954,"thread_start_us":197,"threads_started":1}
I20260811 05:06:17.334903 6151 ts_tablet_manager.cc:1397] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: Time spent bootstrapping tablet: real 0.034s user 0.023s sys 0.004s
I20260811 05:06:17.334908 6267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.314842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:60103 (local address 127.22.49.254:43503)
0811 05:06:17.317443 (+ 2601us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:17.317461 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:17.317500 (+ 39us) server_negotiation.cc:407] Connection header received
0811 05:06:17.317759 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:17.317773 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:17.318135 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:17.319204 (+ 1069us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:17.320025 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.321531 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.323488 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.324142 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.324332 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.327704 (+ 3372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:17.327715 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:17.327746 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:17.327791 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:17.330224 (+ 2433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:17.330883 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:17.330891 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:17.330896 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:17.331094 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:17.331502 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:17.331507 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:17.331511 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:17.331991 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:17.332125 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:17.332735 (+ 610us) server_negotiation.cc:299] Negotiation successful
0811 05:06:17.333029 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2465,"thread_start_us":124,"threads_started":1}
I20260811 05:06:17.337270 6265 heartbeater.cc:347] Connected to a master server at 127.22.49.254:43503
I20260811 05:06:17.337512 6265 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:17.337693 6151 raft_consensus.cc:348] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } } peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } }
I20260811 05:06:17.338037 6265 heartbeater.cc:511] Master 127.22.49.254:43503 requested a full tablet report, sending...
I20260811 05:06:17.338099 6151 raft_consensus.cc:729] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60eb60789ed9455b8fd1a625290c62af, State: Initialized, Role: FOLLOWER
I20260811 05:06:17.338572 6151 consensus_queue.cc:260] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } } peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } }
I20260811 05:06:17.339622 6151 ts_tablet_manager.cc:1428] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260811 05:06:17.341188 6066 ts_manager.cc:194] Registered new tserver with Master: 60eb60789ed9455b8fd1a625290c62af (127.22.49.193:42861)
I20260811 05:06:17.344558 6066 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:60103
I20260811 05:06:17.347112 6265 heartbeater.cc:503] Master 127.22.49.254:43503 was elected leader, sending a full tablet report...
Aug 11 05:06:17 dist-test-slave-w206 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424777, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for kudu/127.22.49.193@KRBTEST.COM
I20260811 05:06:17.354773 6272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.343902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:42861 (local address 127.0.0.1:37658)
0811 05:06:17.344879 (+ 977us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:17.344923 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:17.345058 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:17.345705 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:17.345709 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:17.346012 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:17.346115 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.346120 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.347097 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.347101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.347977 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.347987 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.348825 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.348829 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.348936 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.349500 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:17.349519 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:17.351090 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:17.353105 (+ 2015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:17.353113 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:17.353117 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:17.353366 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:17.353666 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:17.353668 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:17.353669 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:17.353745 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:17.354264 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:17.354269 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:17.354393 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 05:06:17.354507 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 05:06:17.354652 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":805,"thread_start_us":104,"threads_started":1}
I20260811 05:06:17.355166 6273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.343977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37658 (local address 127.22.49.193:42861)
0811 05:06:17.344624 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:17.344636 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:17.345027 (+ 391us) server_negotiation.cc:407] Connection header received
0811 05:06:17.345209 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:17.345214 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:17.345433 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:17.345574 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:17.346235 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.346935 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.348111 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.348586 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.348692 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.351225 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:17.351236 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:17.351248 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:17.351274 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:17.352993 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:17.353475 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:17.353481 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:17.353483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:17.353575 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:17.353872 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:17.353875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:17.353877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:17.354151 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:17.354283 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:17.354608 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 05:06:17.354783 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":81,"threads_started":1}
I20260811 05:06:17.356056 6191 tablet_service.cc:1514] Processing DeleteTablet for tablet f404283fe18c4002a5c39218354b8723 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:16 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:37658
I20260811 05:06:17.356925 6274 tablet_replica.cc:330] stopping tablet replica
I20260811 05:06:17.357244 6274 raft_consensus.cc:2229] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:06:17.357492 6274 raft_consensus.cc:2258] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:06:17.358632 6274 ts_tablet_manager.cc:1905] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:06:17.363305 6274 ts_tablet_manager.cc:1918] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:06:17.363411 6274 log.cc:1196] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal/wals/f404283fe18c4002a5c39218354b8723
I20260811 05:06:17.363699 6274 ts_tablet_manager.cc:1939] T f404283fe18c4002a5c39218354b8723 P 60eb60789ed9455b8fd1a625290c62af: Deleting consensus metadata
I20260811 05:06:17.365684 6051 catalog_manager.cc:4841] TS 60eb60789ed9455b8fd1a625290c62af (127.22.49.193:42861): tablet f404283fe18c4002a5c39218354b8723 (table test-table [id=deef9c703b7d4a8d85740b02e8b8faf5]) successfully deleted
W20260811 05:06:17.443013 6269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:17.443323 6269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:17.443368 6269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:17.447364 6269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:17.447423 6269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:17.447525 6269 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:06:17.452657 6269 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:35939
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=40901
--tserver_master_addrs=127.22.49.254:43503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:17.453703 6269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:17.454717 6269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:17.464515 6279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:17.464602 6282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:17.464644 6269 server_base.cc:1034] running on GCE node
W20260811 05:06:17.464515 6280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:17.465193 6269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:17.465850 6269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:17.467078 6269 hybrid_clock.cc:648] HybridClock initialized: now 1786424777467047 us; error 41 us; skew 500 ppm
Aug 11 05:06:17 dist-test-slave-w206 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424777, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:17.469926 6269 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:06:17.470866 6269 webserver.cc:460] Webserver started at http://127.22.49.194:40901/ using document root <none> and password file <none>
I20260811 05:06:17.471499 6269 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:17.471621 6269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:17.475533 6269 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:06:17.477515 6289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:17.478758 6269 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:06:17.478895 6269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "b5dc51277f924a74b1bd7e65696d3d0f"
format_stamp: "Formatted at 2026-08-11 05:06:16 on dist-test-slave-w206"
server_key: "042dabd7e052b039058109fe13227b7a"
server_key_iv: "73e0f9c8f61e90a6158cf3dfe36376cb"
server_key_version: "encryptionkey@0"
I20260811 05:06:17.479506 6269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:17.502734 6269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:17.506137 6269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:17.506378 6269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:17.507063 6269 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:17.507929 6269 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:17.508013 6269 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:17.508108 6269 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:17.508160 6269 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:17.517905 6269 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:35939
I20260811 05:06:17.517930 6411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:35939 every 8 connection(s)
I20260811 05:06:17.519013 6269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:06:17.526785 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 6269
I20260811 05:06:17.527273 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:37423
--local_ip_for_outbound_sockets=127.22.49.195
--tserver_master_addrs=127.22.49.254:43503
--webserver_port=46697
--webserver_interface=127.22.49.195
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:06:17 dist-test-slave-w206 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424777, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:17.535080 6267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.520946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:55105 (local address 127.22.49.254:43503)
0811 05:06:17.521094 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:17.521098 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:17.522043 (+ 945us) server_negotiation.cc:407] Connection header received
0811 05:06:17.523735 (+ 1692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:17.523739 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:17.523822 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:17.523916 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:17.525134 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.525670 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.527196 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.527491 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.527635 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.530757 (+ 3122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:17.530760 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:17.530762 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:17.530788 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:17.532408 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:17.533133 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:17.533137 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:17.533138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:17.533223 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:17.533695 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:17.533698 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:17.533699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:17.533884 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:17.533960 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:17.534710 (+ 750us) server_negotiation.cc:299] Negotiation successful
0811 05:06:17.534848 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 05:06:17.536322 6414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.521415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:55105)
0811 05:06:17.521885 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:17.521928 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:17.523496 (+ 1568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:17.524100 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:17.524107 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:17.524497 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:17.524979 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.524992 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.525803 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.525807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.527059 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.527071 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.527689 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.527694 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.527914 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.528606 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:17.528630 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:17.530558 (+ 1928us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:17.532538 (+ 1980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:17.532546 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:17.532566 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:17.533027 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:17.533373 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:17.533379 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:17.533383 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:17.533595 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:17.533997 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:17.534007 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:17.534377 (+ 370us) client_negotiation.cc:769] Sending connection context
0811 05:06:17.534630 (+ 253us) client_negotiation.cc:240] Negotiation successful
0811 05:06:17.535106 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":131,"threads_started":1}
I20260811 05:06:17.537812 6412 heartbeater.cc:347] Connected to a master server at 127.22.49.254:43503
I20260811 05:06:17.538102 6412 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:17.538786 6412 heartbeater.cc:511] Master 127.22.49.254:43503 requested a full tablet report, sending...
I20260811 05:06:17.540110 6066 ts_manager.cc:194] Registered new tserver with Master: b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939)
I20260811 05:06:17.540778 6066 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:55105
W20260811 05:06:17.643329 6415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:17.643612 6415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:17.643705 6415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:17.647858 6415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:17.648008 6415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:17.648164 6415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:06:17.653550 6415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:37423
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=46697
--tserver_master_addrs=127.22.49.254:43503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:17.654651 6415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:17.655791 6415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:17.665769 6421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:17.665936 6415 server_base.cc:1034] running on GCE node
W20260811 05:06:17.665781 6425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:17.665771 6422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:17.666440 6415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:17.667162 6415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:17.668346 6415 hybrid_clock.cc:648] HybridClock initialized: now 1786424777668328 us; error 29 us; skew 500 ppm
Aug 11 05:06:17 dist-test-slave-w206 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424777, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:17.671247 6415 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:06:17.672212 6415 webserver.cc:460] Webserver started at http://127.22.49.195:46697/ using document root <none> and password file <none>
I20260811 05:06:17.672793 6415 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:17.672912 6415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:17.676872 6415 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:06:17.678894 6432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:17.680172 6415 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:06:17.680310 6415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "a098372413484f1fb1d56e3735fa3898"
format_stamp: "Formatted at 2026-08-11 05:06:16 on dist-test-slave-w206"
server_key: "b3ff79a8a1d57924e0c0b015473916d3"
server_key_iv: "43c6d5419e112b65cbbf5aad8a26c4c3"
server_key_version: "encryptionkey@0"
I20260811 05:06:17.680853 6415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:17.698268 6415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:17.701764 6415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:17.701990 6415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:17.702615 6415 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:17.703532 6415 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:17.703605 6415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:17.703676 6415 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:17.703724 6415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:17.713676 6415 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:37423
I20260811 05:06:17.713726 6555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:37423 every 8 connection(s)
I20260811 05:06:17.714766 6415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:06:17.715404 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 6415
I20260811 05:06:17.724643 6267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.716222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45330 (local address 127.22.49.254:43503)
0811 05:06:17.716384 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:17.716388 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:17.716639 (+ 251us) server_negotiation.cc:407] Connection header received
0811 05:06:17.716790 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:17.716794 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:17.716857 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:17.716947 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:17.717778 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.718345 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.719331 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.719565 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.719681 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.721180 (+ 1499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:17.721188 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:17.721190 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:17.721212 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:17.722684 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:17.723203 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:17.723229 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:17.723236 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:17.723335 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:17.723700 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:17.723702 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:17.723704 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:17.723874 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:17.724036 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:17.724299 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 05:06:17.724434 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 05:06:17 dist-test-slave-w206 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424777, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:17.729487 6560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.716726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:43487 (local address 127.22.49.254:43503)
0811 05:06:17.716996 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:17.717000 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:17.717861 (+ 861us) server_negotiation.cc:407] Connection header received
0811 05:06:17.719347 (+ 1486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:17.719350 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:17.719403 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:17.719510 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:17.720801 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.721312 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.722410 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.722634 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.722753 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.725540 (+ 2787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:17.725547 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:17.725550 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:17.725575 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:17.727362 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:17.727897 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:17.727901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:17.727902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:17.727993 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:17.728383 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:17.728387 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:17.728389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:17.728576 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:17.728687 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:17.729187 (+ 500us) server_negotiation.cc:299] Negotiation successful
0811 05:06:17.729307 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":96,"threads_started":1}
I20260811 05:06:17.730284 6561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.717257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:43487)
0811 05:06:17.717701 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:17.717762 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:17.719128 (+ 1366us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:17.719684 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:17.719691 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:17.720112 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:17.720652 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.720665 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.721435 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.721444 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.722287 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.722296 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.722788 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.722794 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.722961 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.723576 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:17.723597 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:17.725378 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:17.727489 (+ 2111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:17.727497 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:17.727514 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:17.727787 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:17.728132 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:17.728135 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:17.728137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:17.728281 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:17.728686 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:17.728693 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:17.728944 (+ 251us) client_negotiation.cc:769] Sending connection context
0811 05:06:17.729146 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 05:06:17.729468 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":129,"threads_started":1}
I20260811 05:06:17.731421 6556 heartbeater.cc:347] Connected to a master server at 127.22.49.254:43503
I20260811 05:06:17.731680 6556 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:17.732169 6556 heartbeater.cc:511] Master 127.22.49.254:43503 requested a full tablet report, sending...
I20260811 05:06:17.733199 6066 ts_manager.cc:194] Registered new tserver with Master: a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423)
I20260811 05:06:17.733816 6066 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:43487
I20260811 05:06:17.738174 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:06:17.742760 6560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.738807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45334 (local address 127.22.49.254:43503)
0811 05:06:17.738930 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:17.738933 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:17.739255 (+ 322us) server_negotiation.cc:407] Connection header received
0811 05:06:17.739476 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:17.739478 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:17.739568 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:17.739676 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:06:17.739920 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.740453 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.741311 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.741547 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.741664 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.741989 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:06:17.742352 (+ 363us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:06:17.742482 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:17.742547 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 05:06:17.742624 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 05:06:17.743371 6066 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:45334:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:06:17.746469 6066 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:06:17.754216 6191 tablet_service.cc:1467] Processing CreateTablet for tablet 640e1754c04b4c74a4b5e352bfabdb8c (DEFAULT_TABLE table=test-table [id=3d946fbc789049f8bbf96c3cde90742c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:06:17.754901 6191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 640e1754c04b4c74a4b5e352bfabdb8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:17.757632 6151 tablet_bootstrap.cc:492] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af: Bootstrap starting.
I20260811 05:06:17.758507 6151 tablet_bootstrap.cc:654] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:17.759428 6272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.753065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:37423 (local address 127.0.0.1:42068)
0811 05:06:17.753203 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:17.753221 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:17.753304 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:17.754478 (+ 1174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:17.754484 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:17.754507 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:17.754615 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.754624 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.756411 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.756415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.757597 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.757608 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.758883 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.758886 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.759021 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.759071 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 05:06:17.759177 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 05:06:17.759290 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":3}
I20260811 05:06:17.759441 6567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.753395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42068 (local address 127.22.49.195:37423)
0811 05:06:17.753931 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:17.753940 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:17.753983 (+ 43us) server_negotiation.cc:407] Connection header received
0811 05:06:17.754069 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:17.754075 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:17.754290 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:17.754905 (+ 615us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:17.755089 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.756250 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.757869 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.758753 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.758872 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.759043 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:17.759212 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 05:06:17.759306 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":206,"threads_started":1}
I20260811 05:06:17.759742 6568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.753794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52288 (local address 127.22.49.194:35939)
0811 05:06:17.754144 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:17.754158 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:17.754177 (+ 19us) server_negotiation.cc:407] Connection header received
0811 05:06:17.754241 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:17.754245 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:17.754408 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:17.754590 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:17.754947 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.756408 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.757495 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.758849 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.759304 (+ 455us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.759432 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:17.759470 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 05:06:17.759595 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":136,"threads_started":1}
I20260811 05:06:17.759909 6566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.753343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:35939 (local address 127.0.0.1:52288)
0811 05:06:17.753642 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:17.753656 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:17.753737 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:17.754592 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:17.754599 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:17.754621 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:17.754715 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.754721 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.756569 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.756572 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.757366 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.757374 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.759023 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.759027 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.759134 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.759159 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 05:06:17.759215 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 05:06:17.759743 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"mutex_wait_us":417,"thread_start_us":133,"threads_started":1}
I20260811 05:06:17.760691 6151 tablet_bootstrap.cc:492] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af: No bootstrap required, opened a new log
I20260811 05:06:17.760812 6151 ts_tablet_manager.cc:1397] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:06:17.761334 6151 raft_consensus.cc:348] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:17.761463 6151 raft_consensus.cc:374] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:17.761511 6151 raft_consensus.cc:729] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60eb60789ed9455b8fd1a625290c62af, State: Initialized, Role: FOLLOWER
I20260811 05:06:17.761637 6151 consensus_queue.cc:260] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:17.761891 6151 ts_tablet_manager.cc:1428] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:06:17.762737 6339 tablet_service.cc:1467] Processing CreateTablet for tablet 640e1754c04b4c74a4b5e352bfabdb8c (DEFAULT_TABLE table=test-table [id=3d946fbc789049f8bbf96c3cde90742c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:06:17.762749 6484 tablet_service.cc:1467] Processing CreateTablet for tablet 640e1754c04b4c74a4b5e352bfabdb8c (DEFAULT_TABLE table=test-table [id=3d946fbc789049f8bbf96c3cde90742c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:06:17.763844 6339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 640e1754c04b4c74a4b5e352bfabdb8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:17.763969 6484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 640e1754c04b4c74a4b5e352bfabdb8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:17.770160 6570 tablet_bootstrap.cc:492] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898: Bootstrap starting.
I20260811 05:06:17.770570 6571 tablet_bootstrap.cc:492] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f: Bootstrap starting.
I20260811 05:06:17.772981 6570 tablet_bootstrap.cc:654] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:17.773101 6571 tablet_bootstrap.cc:654] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:17.773844 6571 log.cc:824] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:17.773840 6570 log.cc:824] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:17.775821 6570 tablet_bootstrap.cc:492] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898: No bootstrap required, opened a new log
I20260811 05:06:17.775820 6571 tablet_bootstrap.cc:492] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f: No bootstrap required, opened a new log
I20260811 05:06:17.776036 6570 ts_tablet_manager.cc:1397] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 05:06:17.776043 6571 ts_tablet_manager.cc:1397] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 05:06:17.780243 6571 raft_consensus.cc:348] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:17.780272 6570 raft_consensus.cc:348] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:17.780465 6571 raft_consensus.cc:374] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:17.780490 6570 raft_consensus.cc:374] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:17.780526 6571 raft_consensus.cc:729] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5dc51277f924a74b1bd7e65696d3d0f, State: Initialized, Role: FOLLOWER
I20260811 05:06:17.780555 6570 raft_consensus.cc:729] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a098372413484f1fb1d56e3735fa3898, State: Initialized, Role: FOLLOWER
I20260811 05:06:17.780982 6570 consensus_queue.cc:260] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:17.780983 6571 consensus_queue.cc:260] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:17.781947 6412 heartbeater.cc:503] Master 127.22.49.254:43503 was elected leader, sending a full tablet report...
I20260811 05:06:17.781968 6556 heartbeater.cc:503] Master 127.22.49.254:43503 was elected leader, sending a full tablet report...
I20260811 05:06:17.782001 6570 ts_tablet_manager.cc:1428] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 05:06:17.782094 6571 ts_tablet_manager.cc:1428] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260811 05:06:17.813848 6266 tablet.cc:2369] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:06:17.965978 6558 tablet.cc:2369] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:06:17.989966 6271 raft_consensus.cc:482] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:06:17.990196 6271 raft_consensus.cc:504] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:17.991457 6271 leader_election.cc:288] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423), b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939)
I20260811 05:06:17.995852 6568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.992369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:44745 (local address 127.22.49.194:35939)
0811 05:06:17.992518 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:17.992525 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:17.992589 (+ 64us) server_negotiation.cc:407] Connection header received
0811 05:06:17.992723 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:17.992726 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:17.992811 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:17.992889 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:17.993137 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.993621 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.994757 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.995216 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.995378 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.995428 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:17.995641 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 05:06:17.995727 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 05:06:17.995878 6577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.991707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:37423 (local address 127.22.49.193:53083)
0811 05:06:17.992022 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:17.992035 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:17.992191 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:17.992554 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:17.992559 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:17.992587 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:17.992758 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.992765 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.993655 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.993661 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.994623 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.994633 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.995489 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.995492 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.995590 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.995617 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 05:06:17.995676 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 05:06:17.995725 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":39,"thread_start_us":144,"threads_started":1}
I20260811 05:06:17.995872 6578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.992177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:35939 (local address 127.22.49.193:44745)
0811 05:06:17.992509 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:17.992522 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:17.992606 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:17.992920 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:17.992923 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:17.992941 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:17.993025 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.993031 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.993734 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.993737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.994621 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:17.994630 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.995386 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.995390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:17.995479 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.995527 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 05:06:17.995607 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 05:06:17.995687 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":53,"thread_start_us":78,"threads_started":1}
I20260811 05:06:17.996126 6567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:17.991803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:53083 (local address 127.22.49.195:37423)
0811 05:06:17.991962 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:17.991967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:17.992116 (+ 149us) server_negotiation.cc:407] Connection header received
0811 05:06:17.992376 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:17.992380 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:17.992433 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:17.992514 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:17.992911 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.993541 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.994779 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:17.995253 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:17.995388 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:17.995438 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:17.995930 (+ 492us) server_negotiation.cc:299] Negotiation successful
0811 05:06:17.996006 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 05:06:17.996606 6361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "640e1754c04b4c74a4b5e352bfabdb8c" candidate_uuid: "60eb60789ed9455b8fd1a625290c62af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" is_pre_election: true
I20260811 05:06:17.996667 6504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "640e1754c04b4c74a4b5e352bfabdb8c" candidate_uuid: "60eb60789ed9455b8fd1a625290c62af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a098372413484f1fb1d56e3735fa3898" is_pre_election: true
I20260811 05:06:17.996954 6504 raft_consensus.cc:2454] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60eb60789ed9455b8fd1a625290c62af in term 0.
I20260811 05:06:17.996954 6361 raft_consensus.cc:2454] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60eb60789ed9455b8fd1a625290c62af in term 0.
I20260811 05:06:17.997452 6147 leader_election.cc:302] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60eb60789ed9455b8fd1a625290c62af, a098372413484f1fb1d56e3735fa3898; no voters:
I20260811 05:06:17.997767 6271 raft_consensus.cc:2781] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:06:17.997845 6271 raft_consensus.cc:482] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:06:17.997876 6271 raft_consensus.cc:3037] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:17.999089 6271 raft_consensus.cc:504] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:17.999420 6271 leader_election.cc:288] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 1 election: Requested vote from peers a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423), b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939)
I20260811 05:06:17.999891 6504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "640e1754c04b4c74a4b5e352bfabdb8c" candidate_uuid: "60eb60789ed9455b8fd1a625290c62af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a098372413484f1fb1d56e3735fa3898"
I20260811 05:06:17.999913 6361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "640e1754c04b4c74a4b5e352bfabdb8c" candidate_uuid: "60eb60789ed9455b8fd1a625290c62af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5dc51277f924a74b1bd7e65696d3d0f"
I20260811 05:06:18.000017 6504 raft_consensus.cc:3037] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:18.000065 6361 raft_consensus.cc:3037] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:18.001120 6361 raft_consensus.cc:2454] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60eb60789ed9455b8fd1a625290c62af in term 1.
I20260811 05:06:18.001171 6504 raft_consensus.cc:2454] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60eb60789ed9455b8fd1a625290c62af in term 1.
I20260811 05:06:18.001471 6147 leader_election.cc:302] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60eb60789ed9455b8fd1a625290c62af, a098372413484f1fb1d56e3735fa3898; no voters:
I20260811 05:06:18.001644 6271 raft_consensus.cc:2781] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:06:18.001866 6271 raft_consensus.cc:686] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 LEADER]: Becoming Leader. State: Replica: 60eb60789ed9455b8fd1a625290c62af, State: Running, Role: LEADER
I20260811 05:06:18.002146 6271 consensus_queue.cc:237] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:18.005280 6066 catalog_manager.cc:5495] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af reported cstate change: term changed from 0 to 1, leader changed from <none> to 60eb60789ed9455b8fd1a625290c62af (127.22.49.193). New cstate: current_term: 1 leader_uuid: "60eb60789ed9455b8fd1a625290c62af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } health_report { overall_health: HEALTHY } } }
W20260811 05:06:18.020251 6413 tablet.cc:2369] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:06:18.063046 6581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:18.058717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37660 (local address 127.22.49.193:42861)
0811 05:06:18.059137 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:18.059144 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:18.059156 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:06:18.059230 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:18.059232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:18.059285 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:18.059385 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:06:18.059654 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:18.060262 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:18.061251 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:18.061523 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:18.061614 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:18.061923 (+ 309us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:06:18.062494 (+ 571us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:06:18.062591 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:18.062708 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 05:06:18.062775 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":183,"threads_started":1}
I20260811 05:06:18.067384 6504 raft_consensus.cc:1261] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898 [term 1 FOLLOWER]: Refusing update from remote peer 60eb60789ed9455b8fd1a625290c62af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:06:18.067445 6361 raft_consensus.cc:1261] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f [term 1 FOLLOWER]: Refusing update from remote peer 60eb60789ed9455b8fd1a625290c62af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:06:18.068204 6271 consensus_queue.cc:1035] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:06:18.068454 6579 consensus_queue.cc:1035] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:06:18.075063 6582 mvcc.cc:205] Tried to move back new op lower bound from 7317195890956836864 to 7317195890699145216. Current Snapshot: MvccSnapshot[applied={T|T < 7317195890956836864}]
I20260811 05:06:18.078351 6583 mvcc.cc:205] Tried to move back new op lower bound from 7317195890956836864 to 7317195890699145216. Current Snapshot: MvccSnapshot[applied={T|T < 7317195890956836864}]
I20260811 05:06:18.083854 6584 mvcc.cc:205] Tried to move back new op lower bound from 7317195890956836864 to 7317195890699145216. Current Snapshot: MvccSnapshot[applied={T|T < 7317195890956836864}]
I20260811 05:06:18.086948 6066 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:45334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:06:18.087116 6066 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:45334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:06:18.089416 6066 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: Sending DeleteTablet for 3 replicas of tablet 640e1754c04b4c74a4b5e352bfabdb8c
I20260811 05:06:18.090194 6484 tablet_service.cc:1514] Processing DeleteTablet for tablet 640e1754c04b4c74a4b5e352bfabdb8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:18 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:42068
I20260811 05:06:18.090205 6339 tablet_service.cc:1514] Processing DeleteTablet for tablet 640e1754c04b4c74a4b5e352bfabdb8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:18 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:52288
I20260811 05:06:18.090646 6191 tablet_service.cc:1514] Processing DeleteTablet for tablet 640e1754c04b4c74a4b5e352bfabdb8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:18 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:37658
I20260811 05:06:18.090677 6592 tablet_replica.cc:330] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898: stopping tablet replica
I20260811 05:06:18.090785 6593 tablet_replica.cc:330] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f: stopping tablet replica
I20260811 05:06:18.091054 6592 raft_consensus.cc:2229] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:06:18.091217 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 6108
I20260811 05:06:18.091320 6593 raft_consensus.cc:2229] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:06:18.091391 6592 raft_consensus.cc:2258] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:06:18.091647 6593 raft_consensus.cc:2258] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:06:18.094218 6592 ts_tablet_manager.cc:1905] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:06:18.094555 6593 ts_tablet_manager.cc:1905] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:06:18.097625 6592 ts_tablet_manager.cc:1918] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:06:18.097684 6593 ts_tablet_manager.cc:1918] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:06:18.097745 6592 log.cc:1196] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/640e1754c04b4c74a4b5e352bfabdb8c
I20260811 05:06:18.097824 6593 log.cc:1196] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/640e1754c04b4c74a4b5e352bfabdb8c
I20260811 05:06:18.098116 6592 ts_tablet_manager.cc:1939] T 640e1754c04b4c74a4b5e352bfabdb8c P a098372413484f1fb1d56e3735fa3898: Deleting consensus metadata
I20260811 05:06:18.098201 6593 ts_tablet_manager.cc:1939] T 640e1754c04b4c74a4b5e352bfabdb8c P b5dc51277f924a74b1bd7e65696d3d0f: Deleting consensus metadata
I20260811 05:06:18.099403 6050 catalog_manager.cc:4841] TS b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939): tablet 640e1754c04b4c74a4b5e352bfabdb8c (table test-table [id=3d946fbc789049f8bbf96c3cde90742c]) successfully deleted
I20260811 05:06:18.099644 6050 catalog_manager.cc:4841] TS a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423): tablet 640e1754c04b4c74a4b5e352bfabdb8c (table test-table [id=3d946fbc789049f8bbf96c3cde90742c]) successfully deleted
W20260811 05:06:18.103521 6051 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:42861 (error 108)
I20260811 05:06:18.104439 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 6269
I20260811 05:06:18.104643 6566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:18.104315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:42861 (local address 127.0.0.1:37668)
0811 05:06:18.104455 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:18.104543 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:42861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 05:06:18.111198 6051 catalog_manager.cc:4584] TS 60eb60789ed9455b8fd1a625290c62af (127.22.49.193:42861): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 640e1754c04b4c74a4b5e352bfabdb8c: Network error: Client connection negotiation failed: client connection to 127.22.49.193:42861: connect: Connection refused (error 111)
I20260811 05:06:18.112432 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 6415
I20260811 05:06:18.120460 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 6028
I20260811 05:06:18.129787 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:43503
--webserver_interface=127.22.49.254
--webserver_port=41473
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:43503
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:18.248951 6596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:18.249208 6596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:18.249286 6596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:18.253360 6596 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:06:18.253419 6596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:18.253439 6596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:18.253455 6596 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:06:18.253470 6596 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:06:18.258800 6596 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:43503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:43503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=41473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:18.259941 6596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:18.261031 6596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:18.269748 6604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:18.269865 6596 server_base.cc:1034] running on GCE node
W20260811 05:06:18.269742 6601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:18.269745 6602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:18.270677 6596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:18.271874 6596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:18.273075 6596 hybrid_clock.cc:648] HybridClock initialized: now 1786424778273056 us; error 32 us; skew 500 ppm
Aug 11 05:06:18 dist-test-slave-w206 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424778, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:18.275875 6596 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:06:18.276820 6596 webserver.cc:460] Webserver started at http://127.22.49.254:41473/ using document root <none> and password file <none>
I20260811 05:06:18.277422 6596 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:18.277522 6596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:18.281425 6596 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 05:06:18.283675 6613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:18.284909 6596 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:06:18.285055 6596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1"
format_stamp: "Formatted at 2026-08-11 05:06:15 on dist-test-slave-w206"
server_key: "0fceb5e7882f8d5ad592d5b5ee9f1cdb"
server_key_iv: "32adca6b1247718497dcaa7fc67aa0d3"
server_key_version: "encryptionkey@0"
I20260811 05:06:18.285610 6596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:18.308509 6596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:18.311931 6596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:18.312155 6596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:18.320250 6596 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:43503
I20260811 05:06:18.320546 6666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:43503 every 8 connection(s)
I20260811 05:06:18.321496 6596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:06:18.325949 6667 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:06:18.327461 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 6596
I20260811 05:06:18.328028 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:42861
--local_ip_for_outbound_sockets=127.22.49.193
--tserver_master_addrs=127.22.49.254:43503
--webserver_port=42371
--webserver_interface=127.22.49.193
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:06:18.328159 6667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: Bootstrap starting.
I20260811 05:06:18.347220 6667 log.cc:824] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:18.358830 6667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:06:18.359267 6667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1: Bootstrap complete.
I20260811 05:06:18.363487 6667 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } }
I20260811 05:06:18.363991 6667 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a29c512e68e4c3a9ed0c8ea0fd2f8f1, State: Initialized, Role: FOLLOWER
I20260811 05:06:18.364475 6667 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } }
I20260811 05:06:18.364627 6667 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:06:18.364708 6667 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:06:18.364838 6667 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 2 FOLLOWER]: Advancing to term 3
I20260811 05:06:18.366767 6667 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } }
I20260811 05:06:18.367184 6667 leader_election.cc:302] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a29c512e68e4c3a9ed0c8ea0fd2f8f1; no voters:
I20260811 05:06:18.367544 6667 leader_election.cc:288] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 05:06:18.367657 6674 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 05:06:18.367874 6674 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [term 3 LEADER]: Becoming Leader. State: Replica: 9a29c512e68e4c3a9ed0c8ea0fd2f8f1, State: Running, Role: LEADER
I20260811 05:06:18.368180 6674 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } }
I20260811 05:06:18.368821 6667 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:06:18.369700 6675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } } }
I20260811 05:06:18.369704 6676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a29c512e68e4c3a9ed0c8ea0fd2f8f1. Latest consensus state: current_term: 3 leader_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a29c512e68e4c3a9ed0c8ea0fd2f8f1" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43503 } } }
I20260811 05:06:18.369875 6675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:18.369880 6676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a29c512e68e4c3a9ed0c8ea0fd2f8f1 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:18.370838 6683 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:06:18.375306 6683 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:06:18.375850 6683 catalog_manager.cc:1259] Loaded cluster ID: 3dd26c3792574665bfb49bfb33028e30
I20260811 05:06:18.375927 6683 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 05:06:18.376844 6683 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7efd8a3b09ad google::LogMessage::Fail() at ??:0
@ 0x7efd8a3b388a google::LogMessage::SendToLog() at ??:0
@ 0x7efd8a3b04de google::LogMessage::Flush() at ??:0
@ 0x7efd8a3b1a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7efd94ceffdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7efd94cf0d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7efd94ced579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7efd94d31640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7efd8c6023d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7efd8c602c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7efd8c6043f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7efd8c5f3512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7efd8dc376db start_thread at ??:0
@ 0x7efd88eae61f clone at ??:0
W20260811 05:06:18.462253 6670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:18.462489 6670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:18.462533 6670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:18.466871 6670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:18.466959 6670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:18.467067 6670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:06:18.472412 6670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:42861
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=42371
--tserver_master_addrs=127.22.49.254:43503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:18.473496 6670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:18.474529 6670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:18.484638 6713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:18.484658 6712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:18.484630 6715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:18.484972 6670 server_base.cc:1034] running on GCE node
I20260811 05:06:18.485458 6670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:18.486212 6670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:18.487432 6670 hybrid_clock.cc:648] HybridClock initialized: now 1786424778487408 us; error 38 us; skew 500 ppm
Aug 11 05:06:18 dist-test-slave-w206 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424778, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:18.490604 6670 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:06:18.491724 6670 webserver.cc:460] Webserver started at http://127.22.49.193:42371/ using document root <none> and password file <none>
I20260811 05:06:18.492347 6670 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:18.492416 6670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:18.496795 6670 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:06:18.499218 6724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:18.500651 6670 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:06:18.500756 6670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "60eb60789ed9455b8fd1a625290c62af"
format_stamp: "Formatted at 2026-08-11 05:06:16 on dist-test-slave-w206"
server_key: "6724451fc04c48dc10d6fcac3d658ab7"
server_key_iv: "39fd063ab47b701398dbd659f0369a09"
server_key_version: "encryptionkey@0"
I20260811 05:06:18.501381 6670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:18.522399 6670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:18.526233 6670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:18.526506 6670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:18.527405 6670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:18.528858 6732 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 05:06:18.534492 6670 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 05:06:18.534596 6670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260811 05:06:18.534683 6670 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 05:06:18.536486 6670 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 05:06:18.536562 6670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260811 05:06:18.536872 6732 tablet_bootstrap.cc:492] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af: Bootstrap starting.
I20260811 05:06:18.547566 6670 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:42861
I20260811 05:06:18.547786 6845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:42861 every 8 connection(s)
I20260811 05:06:18.548621 6670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:06:18.557447 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 6670
I20260811 05:06:18.557950 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:35939
--local_ip_for_outbound_sockets=127.22.49.194
--tserver_master_addrs=127.22.49.254:43503
--webserver_port=40901
--webserver_interface=127.22.49.194
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:06:18.559226 6732 log.cc:824] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:18.566910 6732 tablet_bootstrap.cc:492] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:06:18.567360 6732 tablet_bootstrap.cc:492] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af: Bootstrap complete.
I20260811 05:06:18.568562 6732 ts_tablet_manager.cc:1397] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af: Time spent bootstrapping tablet: real 0.032s user 0.018s sys 0.012s
I20260811 05:06:18.571064 6732 raft_consensus.cc:348] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:18.571527 6732 raft_consensus.cc:729] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60eb60789ed9455b8fd1a625290c62af, State: Initialized, Role: FOLLOWER
I20260811 05:06:18.572032 6732 consensus_queue.cc:260] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:18.573025 6732 ts_tablet_manager.cc:1428] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
W20260811 05:06:18.623588 6849 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:06:18.550593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:49693)
0811 05:06:18.551113 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:18.551167 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:18.551999 (+ 832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:18.622742 (+ 70743us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":153,"threads_started":1}
W20260811 05:06:18.624235 6846 heartbeater.cc:644] Failed to heartbeat to 127.22.49.254:43503 (0 consecutive failures): Network error: Failed to ping master at 127.22.49.254:43503: Client connection negotiation failed: client connection to 127.22.49.254:43503: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 05:06:18.625064 6849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:18.624759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:45255)
0811 05:06:18.624926 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:18.625007 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 05:06:18.625844 6849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:18.625613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:56701)
0811 05:06:18.625738 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:18.625787 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 05:06:18.626123 6846 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 05:06:18.695377 6851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:18.695827 6851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:18.695925 6851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:18.700522 6851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:18.700587 6851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:18.700678 6851 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:06:18.706080 6851 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:35939
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=40901
--tserver_master_addrs=127.22.49.254:43503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:18.707314 6851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:18.708367 6851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:06:18.718421 6851 server_base.cc:1034] running on GCE node
W20260811 05:06:18.718441 6859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:18.718485 6861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:18.718613 6857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:18.719229 6851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:18.719878 6851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:18.721119 6851 hybrid_clock.cc:648] HybridClock initialized: now 1786424778721083 us; error 52 us; skew 500 ppm
Aug 11 05:06:18 dist-test-slave-w206 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424778, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:18.724166 6851 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:06:18.725133 6851 webserver.cc:460] Webserver started at http://127.22.49.194:40901/ using document root <none> and password file <none>
I20260811 05:06:18.725706 6851 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:18.725809 6851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:18.729938 6851 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:06:18.732360 6868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:18.733680 6851 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 05:06:18.733831 6851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "b5dc51277f924a74b1bd7e65696d3d0f"
format_stamp: "Formatted at 2026-08-11 05:06:16 on dist-test-slave-w206"
server_key: "042dabd7e052b039058109fe13227b7a"
server_key_iv: "73e0f9c8f61e90a6158cf3dfe36376cb"
server_key_version: "encryptionkey@0"
I20260811 05:06:18.734447 6851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:18.766548 6851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:18.769937 6851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:18.770188 6851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:18.770891 6851 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:18.771780 6851 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:18.771855 6851 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:18.771929 6851 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:18.771979 6851 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:18.782409 6851 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:35939
I20260811 05:06:18.782488 6986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:35939 every 8 connection(s)
I20260811 05:06:18.783645 6851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:06:18.787676 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 6851
I20260811 05:06:18.787905 6989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:18.785753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:45697)
0811 05:06:18.786231 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:18.786385 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":113,"threads_started":1}
I20260811 05:06:18.788322 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:37423
--local_ip_for_outbound_sockets=127.22.49.195
--tserver_master_addrs=127.22.49.254:43503
--webserver_port=46697
--webserver_interface=127.22.49.195
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:34453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:18.788384 6987 heartbeater.cc:644] Failed to heartbeat to 127.22.49.254:43503 (0 consecutive failures): Network error: Failed to ping master at 127.22.49.254:43503: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
I20260811 05:06:18.789048 6989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:18.788822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:38715)
0811 05:06:18.788941 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:18.788988 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 05:06:18.789759 6989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:18.789484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:47083)
0811 05:06:18.789618 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:18.789681 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 05:06:18.789971 6987 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 05:06:18.900590 6992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:18.900870 6992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:18.900913 6992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:18.904989 6992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:18.905045 6992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:18.905135 6992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:06:18.910542 6992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:34453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:37423
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=46697
--tserver_master_addrs=127.22.49.254:43503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:18.911657 6992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:18.912659 6992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:18.922318 7000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:18.922369 6998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:18.922307 6997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:18.922674 6992 server_base.cc:1034] running on GCE node
I20260811 05:06:18.923204 6992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:18.923853 6992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:18.925046 6992 hybrid_clock.cc:648] HybridClock initialized: now 1786424778925034 us; error 29 us; skew 500 ppm
Aug 11 05:06:18 dist-test-slave-w206 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424778, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:18.927995 6992 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:06:18.928911 6992 webserver.cc:460] Webserver started at http://127.22.49.195:46697/ using document root <none> and password file <none>
I20260811 05:06:18.929536 6992 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:18.929634 6992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:18.933418 6992 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 05:06:18.935513 7008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:18.936721 6992 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:06:18.936875 6992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "a098372413484f1fb1d56e3735fa3898"
format_stamp: "Formatted at 2026-08-11 05:06:16 on dist-test-slave-w206"
server_key: "b3ff79a8a1d57924e0c0b015473916d3"
server_key_iv: "43c6d5419e112b65cbbf5aad8a26c4c3"
server_key_version: "encryptionkey@0"
I20260811 05:06:18.937412 6992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:18.951545 6992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:18.954785 6992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:18.955077 6992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:18.955693 6992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:18.956557 6992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:18.956634 6992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:18.956707 6992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:18.956753 6992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:18.965938 6992 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:37423
I20260811 05:06:18.965953 7129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:37423 every 8 connection(s)
I20260811 05:06:18.966945 6992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:06:18.970844 7132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:18.969068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:56633)
0811 05:06:18.969554 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:18.969671 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":124,"threads_started":1}
W20260811 05:06:18.971365 7130 heartbeater.cc:644] Failed to heartbeat to 127.22.49.254:43503 (0 consecutive failures): Network error: Failed to ping master at 127.22.49.254:43503: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
I20260811 05:06:18.971942 7132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:18.971736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:40517)
0811 05:06:18.971846 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:18.971891 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 05:06:18.972582 7132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:18.972350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:58453)
0811 05:06:18.972492 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:18.972536 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260811 05:06:18.972795 7130 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 05:06:18.976187 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 6992
I20260811 05:06:19.627497 7134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:19.626809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:59191)
0811 05:06:19.627205 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:19.627338 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":79,"threads_started":1}
I20260811 05:06:19.791045 7135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:19.790580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:52127)
0811 05:06:19.790851 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:19.790912 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":71,"threads_started":1}
I20260811 05:06:19.973901 7136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:19.973417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:43011)
0811 05:06:19.973715 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:19.973783 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":79,"threads_started":1}
I20260811 05:06:20.114683 7137 raft_consensus.cc:482] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:06:20.114961 7137 raft_consensus.cc:504] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:20.116120 7137 leader_election.cc:288] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423), b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939)
Aug 11 05:06:20 dist-test-slave-w206 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424778, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.194@KRBTEST.COM
Aug 11 05:06:20 dist-test-slave-w206 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424778, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.195@KRBTEST.COM
I20260811 05:06:20.130692 7134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:20.116413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:37423 (local address 127.22.49.193:51165)
0811 05:06:20.116542 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:20.116559 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:20.116680 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:20.118544 (+ 1864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:20.118550 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:20.119142 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:20.119645 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:20.119659 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:20.121044 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:20.121049 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:20.122091 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:20.122104 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:20.122812 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:20.122815 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:20.123012 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:20.123691 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:20.123721 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:20.125982 (+ 2261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:20.128180 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:20.128185 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:20.128194 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:20.128566 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:20.128925 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:20.128929 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:20.128930 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:20.129047 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:20.129665 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:20.129671 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:20.129943 (+ 272us) client_negotiation.cc:769] Sending connection context
0811 05:06:20.130141 (+ 198us) client_negotiation.cc:240] Negotiation successful
0811 05:06:20.130497 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":142,"spinlock_wait_cycles":26240}
I20260811 05:06:20.130704 7138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:20.116614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:51165 (local address 127.22.49.195:37423)
0811 05:06:20.116978 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:20.117038 (+ 60us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:20.117087 (+ 49us) server_negotiation.cc:407] Connection header received
0811 05:06:20.117845 (+ 758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:20.117852 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:20.118183 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:20.118498 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:20.119810 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:20.120922 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:20.122245 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:20.122683 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:20.122844 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:20.126170 (+ 3326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:20.126174 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:20.126184 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:20.126213 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:20.128062 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:20.128683 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:20.128689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:20.128701 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:20.128819 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:20.129144 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:20.129147 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:20.129149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:20.129546 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:20.129690 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:20.130251 (+ 561us) server_negotiation.cc:299] Negotiation successful
0811 05:06:20.130501 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":85,"threads_started":1}
I20260811 05:06:20.130757 7140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:20.117113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:40479 (local address 127.22.49.194:35939)
0811 05:06:20.117384 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:20.117403 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:20.117433 (+ 30us) server_negotiation.cc:407] Connection header received
0811 05:06:20.118033 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:20.118038 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:20.118337 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:20.118610 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:20.119834 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:20.120805 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:20.122225 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:20.122683 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:20.122868 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:20.125923 (+ 3055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:20.125929 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:20.125941 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:20.125970 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:20.128040 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:20.128653 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:20.128661 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:20.128671 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:20.128794 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:20.129143 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:20.129148 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:20.129149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:20.129546 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:20.129690 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:20.130253 (+ 563us) server_negotiation.cc:299] Negotiation successful
0811 05:06:20.130555 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":68,"threads_started":1}
I20260811 05:06:20.130745 7139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:20.116684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:35939 (local address 127.22.49.193:40479)
0811 05:06:20.117023 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:20.117039 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:20.117141 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:20.118557 (+ 1416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:20.118560 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:20.119155 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:20.119645 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:20.119659 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:20.120954 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:20.120958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:20.122087 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:20.122097 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:20.123163 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:20.123170 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:20.123276 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:20.123718 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:20.123741 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:20.125635 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:20.128169 (+ 2534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:20.128175 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:20.128188 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:20.128532 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:20.128896 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:20.128900 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:20.128902 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:20.129044 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:20.129667 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:20.129673 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:20.129947 (+ 274us) client_negotiation.cc:769] Sending connection context
0811 05:06:20.130141 (+ 194us) client_negotiation.cc:240] Negotiation successful
0811 05:06:20.130583 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":292,"spinlock_wait_cycles":36224,"thread_start_us":109,"threads_started":1}
W20260811 05:06:20.133883 6727 leader_election.cc:341] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423): Not found: Tablet not found: 640e1754c04b4c74a4b5e352bfabdb8c
W20260811 05:06:20.134164 6727 leader_election.cc:341] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939): Not found: Tablet not found: 640e1754c04b4c74a4b5e352bfabdb8c
I20260811 05:06:20.134232 6727 leader_election.cc:302] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60eb60789ed9455b8fd1a625290c62af; no voters: a098372413484f1fb1d56e3735fa3898, b5dc51277f924a74b1bd7e65696d3d0f
I20260811 05:06:20.134533 7137 raft_consensus.cc:2726] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:06:20.628752 7139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:20.628378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:51929)
0811 05:06:20.628551 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:20.628627 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 05:06:20.792200 7141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:20.791784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:46107)
0811 05:06:20.792053 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:20.792114 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":73,"threads_started":1}
I20260811 05:06:20.975240 7142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:20.974698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:60589)
0811 05:06:20.975079 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:20.975144 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":114,"threads_started":1}
I20260811 05:06:21.630116 7143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:21.629659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:48865)
0811 05:06:21.629950 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:21.630014 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":86,"threads_started":1}
I20260811 05:06:21.793545 7144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:21.793031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:44529)
0811 05:06:21.793351 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:21.793422 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":94,"threads_started":1}
I20260811 05:06:21.842100 7145 raft_consensus.cc:482] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:06:21.842238 7145 raft_consensus.cc:504] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:21.842695 7145 leader_election.cc:288] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423), b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939)
W20260811 05:06:21.843828 6727 leader_election.cc:341] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423): Not found: Tablet not found: 640e1754c04b4c74a4b5e352bfabdb8c
W20260811 05:06:21.844029 6727 leader_election.cc:341] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939): Not found: Tablet not found: 640e1754c04b4c74a4b5e352bfabdb8c
I20260811 05:06:21.844107 6727 leader_election.cc:302] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60eb60789ed9455b8fd1a625290c62af; no voters: a098372413484f1fb1d56e3735fa3898, b5dc51277f924a74b1bd7e65696d3d0f
I20260811 05:06:21.844363 7145 raft_consensus.cc:2726] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:06:21.976598 7146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:21.976121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:50557)
0811 05:06:21.976442 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:21.976500 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":75,"threads_started":1}
I20260811 05:06:22.631440 7147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:22.630928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:35169)
0811 05:06:22.631275 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:22.631342 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":162,"threads_started":1}
I20260811 05:06:22.794935 7148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:22.794388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:50341)
0811 05:06:22.794719 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:22.794789 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":110,"threads_started":1}
I20260811 05:06:22.977846 7149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:22.977438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:34911)
0811 05:06:22.977692 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:22.977748 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":79,"threads_started":1}
I20260811 05:06:23.632987 7150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:23.632492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:39739)
0811 05:06:23.632817 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:23.632878 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":81,"threads_started":1}
I20260811 05:06:23.796135 7151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:23.795676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:39583)
0811 05:06:23.795974 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:23.796036 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":80,"threads_started":1}
I20260811 05:06:23.979319 7153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:23.978721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:42401)
0811 05:06:23.979114 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:23.979178 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":86,"threads_started":1}
I20260811 05:06:24.390117 7154 raft_consensus.cc:482] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:06:24.390251 7154 raft_consensus.cc:504] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:24.390632 7154 leader_election.cc:288] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423), b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939)
W20260811 05:06:24.391567 6727 leader_election.cc:341] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423): Not found: Tablet not found: 640e1754c04b4c74a4b5e352bfabdb8c
W20260811 05:06:24.391752 6727 leader_election.cc:341] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939): Not found: Tablet not found: 640e1754c04b4c74a4b5e352bfabdb8c
I20260811 05:06:24.391814 6727 leader_election.cc:302] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60eb60789ed9455b8fd1a625290c62af; no voters: a098372413484f1fb1d56e3735fa3898, b5dc51277f924a74b1bd7e65696d3d0f
I20260811 05:06:24.391966 7154 raft_consensus.cc:2726] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:06:24.634451 7155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:24.633974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:35793)
0811 05:06:24.634289 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:24.634352 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":83,"threads_started":1}
I20260811 05:06:24.797302 7156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:24.796887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:58295)
0811 05:06:24.797143 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:24.797198 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":74,"threads_started":1}
I20260811 05:06:24.980753 7157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:24.980213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:51569)
0811 05:06:24.980557 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:24.980629 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":100,"threads_started":1}
I20260811 05:06:25.635885 7158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:25.635385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:41151)
0811 05:06:25.635691 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:25.635767 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":95,"threads_started":1}
I20260811 05:06:25.798689 7159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:25.798126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:60591)
0811 05:06:25.798527 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:25.798591 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":149,"threads_started":1}
I20260811 05:06:25.982147 7160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:25.981639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:37395)
0811 05:06:25.981983 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:25.982047 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":88,"threads_started":1}
I20260811 05:06:26.637153 7161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:26.636677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:59747)
0811 05:06:26.636976 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:26.637037 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":85,"threads_started":1}
I20260811 05:06:26.799926 7162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:26.799503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:33033)
0811 05:06:26.799776 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:26.799831 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":96,"threads_started":1}
I20260811 05:06:26.983626 7163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:26.983177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:38397)
0811 05:06:26.983458 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:26.983527 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":91,"threads_started":1}
I20260811 05:06:27.442833 7164 raft_consensus.cc:482] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:06:27.443037 7164 raft_consensus.cc:504] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:27.443531 7164 leader_election.cc:288] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423), b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939)
W20260811 05:06:27.444427 6727 leader_election.cc:341] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939): Not found: Tablet not found: 640e1754c04b4c74a4b5e352bfabdb8c
W20260811 05:06:27.444571 6727 leader_election.cc:341] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423): Not found: Tablet not found: 640e1754c04b4c74a4b5e352bfabdb8c
I20260811 05:06:27.444707 6727 leader_election.cc:302] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60eb60789ed9455b8fd1a625290c62af; no voters: a098372413484f1fb1d56e3735fa3898, b5dc51277f924a74b1bd7e65696d3d0f
I20260811 05:06:27.444907 7164 raft_consensus.cc:2726] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:06:27.638477 7165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:27.638041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:34619)
0811 05:06:27.638314 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:27.638378 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":76,"threads_started":1}
I20260811 05:06:27.801153 7166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:27.800735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:60357)
0811 05:06:27.801003 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:27.801059 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":87,"threads_started":1}
I20260811 05:06:27.985064 7167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:27.984511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:52235)
0811 05:06:27.984910 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:27.984968 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":142,"threads_started":1}
I20260811 05:06:28.640033 7168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:28.639495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:37407)
0811 05:06:28.639836 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:28.639913 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":110,"threads_started":1}
I20260811 05:06:28.802506 7170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:28.802073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:43905)
0811 05:06:28.802353 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:28.802412 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":81,"threads_started":1}
I20260811 05:06:28.986523 7171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:28.986009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:60635)
0811 05:06:28.986336 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:28.986397 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":94,"threads_started":1}
I20260811 05:06:29.038028 7173 raft_consensus.cc:482] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:06:29.038172 7173 raft_consensus.cc:504] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a098372413484f1fb1d56e3735fa3898" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37423 } } peers { permanent_uuid: "b5dc51277f924a74b1bd7e65696d3d0f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35939 } } peers { permanent_uuid: "60eb60789ed9455b8fd1a625290c62af" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 42861 } }
I20260811 05:06:29.038746 7173 leader_election.cc:288] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423), b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939)
W20260811 05:06:29.039803 6727 leader_election.cc:341] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b5dc51277f924a74b1bd7e65696d3d0f (127.22.49.194:35939): Not found: Tablet not found: 640e1754c04b4c74a4b5e352bfabdb8c
W20260811 05:06:29.040005 6727 leader_election.cc:341] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a098372413484f1fb1d56e3735fa3898 (127.22.49.195:37423): Not found: Tablet not found: 640e1754c04b4c74a4b5e352bfabdb8c
I20260811 05:06:29.040082 6727 leader_election.cc:302] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60eb60789ed9455b8fd1a625290c62af; no voters: a098372413484f1fb1d56e3735fa3898, b5dc51277f924a74b1bd7e65696d3d0f
I20260811 05:06:29.040261 7173 raft_consensus.cc:2726] T 640e1754c04b4c74a4b5e352bfabdb8c P 60eb60789ed9455b8fd1a625290c62af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:06:29.641551 7174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:29.640989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:50565)
0811 05:06:29.641313 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:29.641401 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":151,"threads_started":1}
I20260811 05:06:29.803843 7176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:29.803393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:47205)
0811 05:06:29.803686 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:29.803744 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":96,"threads_started":1}
I20260811 05:06:29.987859 7177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:29.987435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:59243)
0811 05:06:29.987706 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:29.987763 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":89,"threads_started":1}
I20260811 05:06:30.642761 7178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:30.642361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:49841)
0811 05:06:30.642610 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:30.642666 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":79,"threads_started":1}
I20260811 05:06:30.805089 7180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:30.804647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:60387)
0811 05:06:30.804934 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:30.804994 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":102,"threads_started":1}
I20260811 05:06:30.989344 7181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:30.988812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:35913)
0811 05:06:30.989133 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:30.989198 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":92,"threads_started":1}
I20260811 05:06:31.644029 7182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:31.643622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:41431)
0811 05:06:31.643873 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:31.643932 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":79,"threads_started":1}
I20260811 05:06:31.806618 7183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:31.806109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:46591)
0811 05:06:31.806414 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:31.806478 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":84,"threads_started":1}
I20260811 05:06:31.990782 7184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:31.990252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:40143)
0811 05:06:31.990600 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:31.990672 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":87,"threads_started":1}
I20260811 05:06:32.645233 7185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:32.644792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:44831)
0811 05:06:32.645065 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:32.645129 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":73,"threads_started":1}
I20260811 05:06:32.808216 7186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:32.807734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:36133)
0811 05:06:32.808038 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:32.808109 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":117,"threads_started":1}
I20260811 05:06:32.992221 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:32.991698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:59403)
0811 05:06:32.992059 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:32.992116 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":128,"threads_started":1}
I20260811 05:06:33.646793 7188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:33.646365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.193:34629)
0811 05:06:33.646635 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:33.646695 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":81,"threads_started":1}
I20260811 05:06:33.809618 7189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:33.809182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.194:59971)
0811 05:06:33.809458 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:33.809518 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":83,"threads_started":1}
I20260811 05:06:33.981775 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 6670
I20260811 05:06:33.992805 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 6851
I20260811 05:06:33.995631 7190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:33.994646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:43503 (local address 127.22.49.195:36927)
0811 05:06:33.995394 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:33.995477 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:43503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":266,"threads_started":1}
I20260811 05:06:34.001222 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 6992
2026-08-11T05:06:34Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19465 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:06:34 dist-test-slave-w206 krb5kdc[7193](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:06:34 dist-test-slave-w206 krb5kdc[7193](info): set up 2 sockets
Aug 11 05:06:34 dist-test-slave-w206 krb5kdc[7193](info): commencing operation
krb5kdc: starting...
W20260811 05:06:35.206736 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:06:35 dist-test-slave-w206 krb5kdc[7193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:06:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:06:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:06:35.342368 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:35753
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:35753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:35.455192 7209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:35.455519 7209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:35.455631 7209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:35.459630 7209 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 05:06:35.459712 7209 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 05:06:35.459739 7209 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 05:06:35.459774 7209 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:06:35.459818 7209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:35.459873 7209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:35.459913 7209 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:06:35.459949 7209 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:06:35.465258 7209 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:35753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:35753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:35.466394 7209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:35.467533 7209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:35.476308 7218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:35.476320 7215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:35.476470 7209 server_base.cc:1034] running on GCE node
W20260811 05:06:35.476305 7214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:35.477157 7209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:35.478236 7209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:35.479408 7209 hybrid_clock.cc:648] HybridClock initialized: now 1786424795479379 us; error 40 us; skew 500 ppm
Aug 11 05:06:35 dist-test-slave-w206 krb5kdc[7193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424795, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:35.486128 7209 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:06:35.487320 7209 webserver.cc:460] Webserver started at http://127.22.49.254:41509/ using document root <none> and password file <none>
I20260811 05:06:35.487946 7209 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:35.488013 7209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:35.488245 7209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:06:35.490406 7209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "dd811024b65f4ed7b535aaab06bb0b83"
format_stamp: "Formatted at 2026-08-11 05:06:35 on dist-test-slave-w206"
server_key: "f19f4bbf30264aecc7a732684838545a"
server_key_iv: "5b6e38d35b5bffc6e66293329dbe4a28"
server_key_version: "encryptionkey@0"
I20260811 05:06:35.491062 7209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "dd811024b65f4ed7b535aaab06bb0b83"
format_stamp: "Formatted at 2026-08-11 05:06:35 on dist-test-slave-w206"
server_key: "f19f4bbf30264aecc7a732684838545a"
server_key_iv: "5b6e38d35b5bffc6e66293329dbe4a28"
server_key_version: "encryptionkey@0"
I20260811 05:06:35.495499 7209 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 05:06:35.497996 7226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:35.499503 7209 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:06:35.499662 7209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "dd811024b65f4ed7b535aaab06bb0b83"
format_stamp: "Formatted at 2026-08-11 05:06:35 on dist-test-slave-w206"
server_key: "f19f4bbf30264aecc7a732684838545a"
server_key_iv: "5b6e38d35b5bffc6e66293329dbe4a28"
server_key_version: "encryptionkey@0"
I20260811 05:06:35.499787 7209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:35.529573 7209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:35.533265 7209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:35.533543 7209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:35.541047 7209 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:35753
I20260811 05:06:35.541409 7282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:35753 every 8 connection(s)
I20260811 05:06:35.542047 7209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:06:35.544900 7283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:35.550467 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 7209
I20260811 05:06:35.550611 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:06:35.550639 7283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Bootstrap starting.
I20260811 05:06:35.550916 22727 external_mini_cluster.cc:1428] Setting key dbb561951a0c60c6ed8d184262127e70
I20260811 05:06:35.553337 7283 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:35.554159 7283 log.cc:824] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:35.556414 7283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: No bootstrap required, opened a new log
Aug 11 05:06:35 dist-test-slave-w206 krb5kdc[7193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:35.561039 7283 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } }
I20260811 05:06:35.561295 7283 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:35.561374 7283 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd811024b65f4ed7b535aaab06bb0b83, State: Initialized, Role: FOLLOWER
I20260811 05:06:35.561852 7283 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } }
I20260811 05:06:35.562009 7283 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:06:35.562096 7283 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:06:35.562230 7283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:35.563301 7283 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } }
I20260811 05:06:35.563638 7283 leader_election.cc:302] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd811024b65f4ed7b535aaab06bb0b83; no voters:
I20260811 05:06:35.563987 7283 leader_election.cc:288] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:06:35.564064 7288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:06:35.564277 7288 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 1 LEADER]: Becoming Leader. State: Replica: dd811024b65f4ed7b535aaab06bb0b83, State: Running, Role: LEADER
I20260811 05:06:35.564641 7288 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } }
I20260811 05:06:35.565335 7283 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:06:35.566495 7290 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd811024b65f4ed7b535aaab06bb0b83. Latest consensus state: current_term: 1 leader_uuid: "dd811024b65f4ed7b535aaab06bb0b83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } } }
I20260811 05:06:35.566653 7290 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:35.567057 7289 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd811024b65f4ed7b535aaab06bb0b83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } } }
I20260811 05:06:35.567111 7298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:06:35.567230 7289 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:35.567586 7286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:35.552297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51324 (local address 127.22.49.254:35753)
0811 05:06:35.552716 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:35.552732 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:35.552774 (+ 42us) server_negotiation.cc:407] Connection header received
0811 05:06:35.553410 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:35.553434 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:35.553774 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:35.554040 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:35.555007 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:35.556187 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:35.557422 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:35.557998 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:35.558149 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:35.561396 (+ 3247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:35.561407 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:35.561437 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:35.561497 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:35.563847 (+ 2350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:35.564458 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:35.564464 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:35.564470 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:35.564626 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:35.564968 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:35.564972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:35.564974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:35.565450 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:35.565674 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:35.566013 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 05:06:35.566409 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":135,"threads_started":1}
I20260811 05:06:35.570641 7298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:06:35.576198 7298 catalog_manager.cc:1347] Generated new cluster ID: e36604a7abba423fa43c5bcd61a970ff
I20260811 05:06:35.576272 7298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:06:35.589006 7298 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:06:35.590364 7298 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:06:35.601837 7298 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Generated new TSK 0
I20260811 05:06:35.602761 7298 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:06:35.646590 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35753
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:35.770805 7311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:35.771095 7311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:35.771170 7311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:35.775283 7311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:35.775342 7311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:35.775444 7311 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:06:35.780699 7311 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:35.781876 7311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:35.782917 7311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:35.792582 7320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:35.792577 7317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:35.792577 7318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:35.792706 7311 server_base.cc:1034] running on GCE node
I20260811 05:06:35.793403 7311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:35.794066 7311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:35.795324 7311 hybrid_clock.cc:648] HybridClock initialized: now 1786424795795306 us; error 35 us; skew 500 ppm
Aug 11 05:06:35 dist-test-slave-w206 krb5kdc[7193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424795, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:35.798311 7311 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:06:35.799391 7311 webserver.cc:460] Webserver started at http://127.22.49.193:37555/ using document root <none> and password file <none>
I20260811 05:06:35.800028 7311 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:35.800132 7311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:35.800395 7311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:06:35.802587 7311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "2d22b1610e024f3abcb45f0312963ac7"
format_stamp: "Formatted at 2026-08-11 05:06:35 on dist-test-slave-w206"
server_key: "a43eac48e9b0c0bc58f6aa727fdb36cb"
server_key_iv: "124b7e9c439282ebe4559daaeed8e8ed"
server_key_version: "encryptionkey@0"
I20260811 05:06:35.803267 7311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "2d22b1610e024f3abcb45f0312963ac7"
format_stamp: "Formatted at 2026-08-11 05:06:35 on dist-test-slave-w206"
server_key: "a43eac48e9b0c0bc58f6aa727fdb36cb"
server_key_iv: "124b7e9c439282ebe4559daaeed8e8ed"
server_key_version: "encryptionkey@0"
I20260811 05:06:35.807453 7311 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 05:06:35.810094 7328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:35.811543 7311 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:06:35.811699 7311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "2d22b1610e024f3abcb45f0312963ac7"
format_stamp: "Formatted at 2026-08-11 05:06:35 on dist-test-slave-w206"
server_key: "a43eac48e9b0c0bc58f6aa727fdb36cb"
server_key_iv: "124b7e9c439282ebe4559daaeed8e8ed"
server_key_version: "encryptionkey@0"
I20260811 05:06:35.811832 7311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:35.836695 7311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:35.840153 7311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:35.840427 7311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:35.841113 7311 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:35.842005 7311 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:35.842082 7311 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:35.842165 7311 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:35.842213 7311 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:35.853019 7311 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:36669
I20260811 05:06:35.853063 7448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:36669 every 8 connection(s)
I20260811 05:06:35.854080 7311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:06:35.855167 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 7311
I20260811 05:06:35.855368 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:06:35.855707 22727 external_mini_cluster.cc:1428] Setting key 8e148662c39aea9672dc805855f11ce1
Aug 11 05:06:35 dist-test-slave-w206 krb5kdc[7193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424795, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:06:35.870042 7286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:35.856232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:56199 (local address 127.22.49.254:35753)
0811 05:06:35.856408 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:35.856415 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:35.857245 (+ 830us) server_negotiation.cc:407] Connection header received
0811 05:06:35.858663 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:35.858669 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:35.858738 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:35.858853 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:35.860753 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:35.861354 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:35.862684 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:35.862959 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:35.863139 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:35.865848 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:35.865858 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:35.865860 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:35.865886 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:35.867730 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:35.868259 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:35.868263 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:35.868264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:35.868363 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:35.868812 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:35.868814 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:35.868815 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:35.868998 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:35.869116 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:35.869792 (+ 676us) server_negotiation.cc:299] Negotiation successful
0811 05:06:35.869912 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
I20260811 05:06:35.870946 7452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:35.856646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:56199)
0811 05:06:35.857098 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:35.857151 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:35.858439 (+ 1288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:35.859124 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:35.859131 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:35.859721 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:35.860560 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:35.860584 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:35.861495 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:35.861498 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:35.862535 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:35.862546 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:35.863179 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:35.863184 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:35.863375 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:35.864038 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:35.864056 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:35.865670 (+ 1614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:35.867861 (+ 2191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:35.867866 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:35.867881 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:35.868145 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:35.868466 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:35.868469 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:35.868471 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:35.868671 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:35.869121 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:35.869130 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:35.869498 (+ 368us) client_negotiation.cc:769] Sending connection context
0811 05:06:35.869707 (+ 209us) client_negotiation.cc:240] Negotiation successful
0811 05:06:35.869977 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":137,"threads_started":1}
I20260811 05:06:35.872350 7449 heartbeater.cc:347] Connected to a master server at 127.22.49.254:35753
I20260811 05:06:35.872604 7449 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:35.873149 7449 heartbeater.cc:511] Master 127.22.49.254:35753 requested a full tablet report, sending...
I20260811 05:06:35.874656 7244 ts_manager.cc:194] Registered new tserver with Master: 2d22b1610e024f3abcb45f0312963ac7 (127.22.49.193:36669)
I20260811 05:06:35.875859 7244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:56199
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:06:35.886873 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35753
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:35.998420 7456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:35.998647 7456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:35.998689 7456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:36.002640 7456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:36.002700 7456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:36.002758 7456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:06:36.008111 7456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:36.009080 7456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:36.010051 7456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:06:36.020291 7456 server_base.cc:1034] running on GCE node
W20260811 05:06:36.020205 7464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:36.020179 7461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:36.020211 7462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:36.020905 7456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:36.021494 7456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:36.022660 7456 hybrid_clock.cc:648] HybridClock initialized: now 1786424796022645 us; error 29 us; skew 500 ppm
Aug 11 05:06:36 dist-test-slave-w206 krb5kdc[7193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424796, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:36.025635 7456 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:06:36.026566 7456 webserver.cc:460] Webserver started at http://127.22.49.194:36559/ using document root <none> and password file <none>
I20260811 05:06:36.027199 7456 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:36.027263 7456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:36.027478 7456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:06:36.029536 7456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "257bcb3589484ef2b7b7cba8be9789d1"
format_stamp: "Formatted at 2026-08-11 05:06:36 on dist-test-slave-w206"
server_key: "98d0a00b1f8c462d45ca53d7113bc0a0"
server_key_iv: "45dc1459a07b2781a1c586a15063f20e"
server_key_version: "encryptionkey@0"
I20260811 05:06:36.030100 7456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "257bcb3589484ef2b7b7cba8be9789d1"
format_stamp: "Formatted at 2026-08-11 05:06:36 on dist-test-slave-w206"
server_key: "98d0a00b1f8c462d45ca53d7113bc0a0"
server_key_iv: "45dc1459a07b2781a1c586a15063f20e"
server_key_version: "encryptionkey@0"
I20260811 05:06:36.033931 7456 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 05:06:36.036477 7471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:36.037707 7456 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 05:06:36.037855 7456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "257bcb3589484ef2b7b7cba8be9789d1"
format_stamp: "Formatted at 2026-08-11 05:06:36 on dist-test-slave-w206"
server_key: "98d0a00b1f8c462d45ca53d7113bc0a0"
server_key_iv: "45dc1459a07b2781a1c586a15063f20e"
server_key_version: "encryptionkey@0"
I20260811 05:06:36.037971 7456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:36.055150 7456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:36.058635 7456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:36.058851 7456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:36.059515 7456 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:36.060377 7456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:36.060451 7456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:36.060524 7456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:36.060561 7456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:36.070040 7456 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:38389
I20260811 05:06:36.070102 7595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:38389 every 8 connection(s)
I20260811 05:06:36.071146 7456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:06:36.074250 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 7456
I20260811 05:06:36.074412 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:06:36.074724 22727 external_mini_cluster.cc:1428] Setting key b2fa8a2135a66c076fe079fd3b11ea8a
Aug 11 05:06:36 dist-test-slave-w206 krb5kdc[7193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424796, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
I20260811 05:06:36.085408 7286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.073073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:47309 (local address 127.22.49.254:35753)
0811 05:06:36.073233 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:36.073237 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:36.074081 (+ 844us) server_negotiation.cc:407] Connection header received
0811 05:06:36.075796 (+ 1715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:36.075799 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:36.075840 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:36.075939 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:36.077167 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.077687 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.078829 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.079114 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.079228 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.081704 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:36.081713 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:36.081715 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:36.081738 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:36.083343 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:36.083870 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:36.083874 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:36.083878 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:36.083956 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:36.084304 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:36.084309 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:36.084310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:36.084492 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:36.084601 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:36.085089 (+ 488us) server_negotiation.cc:299] Negotiation successful
0811 05:06:36.085221 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 05:06:36.086261 7599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.073458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:47309)
0811 05:06:36.073927 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:36.073970 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:36.075586 (+ 1616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:36.076139 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:36.076148 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:36.076549 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:36.077021 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.077034 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.077829 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.077832 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.078694 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.078703 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.079266 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.079269 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.079453 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.080084 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:36.080101 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:36.081540 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:36.083467 (+ 1927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:36.083472 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:36.083488 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:36.083758 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:36.084051 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:36.084055 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:36.084057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:36.084198 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:36.084600 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:36.084606 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:36.084858 (+ 252us) client_negotiation.cc:769] Sending connection context
0811 05:06:36.085047 (+ 189us) client_negotiation.cc:240] Negotiation successful
0811 05:06:36.085371 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":120,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
I20260811 05:06:36.087764 7596 heartbeater.cc:347] Connected to a master server at 127.22.49.254:35753
I20260811 05:06:36.088063 7596 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:36.088737 7596 heartbeater.cc:511] Master 127.22.49.254:35753 requested a full tablet report, sending...
I20260811 05:06:36.090095 7244 ts_manager.cc:194] Registered new tserver with Master: 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389)
I20260811 05:06:36.091055 7244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:47309
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:06:36.106523 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35753
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:36.220453 7602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:36.220705 7602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:36.220750 7602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:36.224886 7602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:36.224939 7602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:36.225031 7602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:06:36.230321 7602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:36.231631 7602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:36.233157 7602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:06:36.243788 7602 server_base.cc:1034] running on GCE node
W20260811 05:06:36.243826 7608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:36.243826 7609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:36.243939 7611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:36.244426 7602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:36.245124 7602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:36.246322 7602 hybrid_clock.cc:648] HybridClock initialized: now 1786424796246308 us; error 26 us; skew 500 ppm
Aug 11 05:06:36 dist-test-slave-w206 krb5kdc[7193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424796, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:36.249215 7602 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:06:36.250092 7602 webserver.cc:460] Webserver started at http://127.22.49.195:44973/ using document root <none> and password file <none>
I20260811 05:06:36.250651 7602 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:36.250746 7602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:36.251070 7602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:06:36.253099 7602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "4078da34cd9943a48816009d38f299b9"
format_stamp: "Formatted at 2026-08-11 05:06:36 on dist-test-slave-w206"
server_key: "ae910609bfe6da3459c3cd49ac84c9dc"
server_key_iv: "9cc962b436411b759197675f45cb777e"
server_key_version: "encryptionkey@0"
I20260811 05:06:36.253902 7602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "4078da34cd9943a48816009d38f299b9"
format_stamp: "Formatted at 2026-08-11 05:06:36 on dist-test-slave-w206"
server_key: "ae910609bfe6da3459c3cd49ac84c9dc"
server_key_iv: "9cc962b436411b759197675f45cb777e"
server_key_version: "encryptionkey@0"
I20260811 05:06:36.257756 7602 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 05:06:36.260426 7619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:36.261653 7602 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 05:06:36.261749 7602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "4078da34cd9943a48816009d38f299b9"
format_stamp: "Formatted at 2026-08-11 05:06:36 on dist-test-slave-w206"
server_key: "ae910609bfe6da3459c3cd49ac84c9dc"
server_key_iv: "9cc962b436411b759197675f45cb777e"
server_key_version: "encryptionkey@0"
I20260811 05:06:36.261893 7602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:36.275771 7602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:36.278643 7602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:36.278818 7602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:36.279426 7602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:36.280220 7602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:36.280277 7602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:36.280315 7602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:36.280366 7602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:36.290298 7602 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:40453
I20260811 05:06:36.290335 7742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:40453 every 8 connection(s)
I20260811 05:06:36.291270 7602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:06:36.294044 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 7602
I20260811 05:06:36.294195 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:06:36.294546 22727 external_mini_cluster.cc:1428] Setting key 84bb2c2395ccf01e73e9e76386aee3f6
Aug 11 05:06:36 dist-test-slave-w206 krb5kdc[7193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424796, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:36.306461 7286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.293223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:48373 (local address 127.22.49.254:35753)
0811 05:06:36.293408 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:36.293411 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:36.294319 (+ 908us) server_negotiation.cc:407] Connection header received
0811 05:06:36.296096 (+ 1777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:36.296099 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:36.296146 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:36.296220 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:36.297472 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.298048 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.299383 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.299614 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.299696 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.302217 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:36.302220 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:36.302222 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:36.302250 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:36.304110 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:36.304840 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:36.304843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:36.304844 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:36.304932 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:36.305358 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:36.305361 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:36.305362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:36.305558 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:36.305647 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:36.306183 (+ 536us) server_negotiation.cc:299] Negotiation successful
0811 05:06:36.306339 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260811 05:06:36.307370 7745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.293605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:48373)
0811 05:06:36.294086 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:36.294157 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:36.295860 (+ 1703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:36.296391 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:36.296400 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:36.296873 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:36.297340 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.297353 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.298200 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.298203 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.299245 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.299256 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.299757 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.299760 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.299908 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.300516 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:36.300533 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:36.302052 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:36.304300 (+ 2248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:36.304306 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:36.304318 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:36.304600 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:36.305038 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:36.305040 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:36.305042 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:36.305200 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:36.305689 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:36.305694 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:36.305952 (+ 258us) client_negotiation.cc:769] Sending connection context
0811 05:06:36.306116 (+ 164us) client_negotiation.cc:240] Negotiation successful
0811 05:06:36.306395 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":180,"threads_started":1}
I20260811 05:06:36.308561 7743 heartbeater.cc:347] Connected to a master server at 127.22.49.254:35753
I20260811 05:06:36.308818 7743 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:36.309353 7743 heartbeater.cc:511] Master 127.22.49.254:35753 requested a full tablet report, sending...
I20260811 05:06:36.310461 7244 ts_manager.cc:194] Registered new tserver with Master: 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453)
I20260811 05:06:36.311185 7244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:48373
I20260811 05:06:36.320526 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:06:36.330354 7286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.322684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52856 (local address 127.22.49.254:35753)
0811 05:06:36.322820 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:36.322825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:36.323046 (+ 221us) server_negotiation.cc:407] Connection header received
0811 05:06:36.323200 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:36.323206 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:36.323255 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:36.323348 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:36.324076 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.324606 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.325460 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.325757 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.325866 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.327352 (+ 1486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:36.327356 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:36.327359 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:36.327387 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:36.328623 (+ 1236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:36.329055 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:36.329058 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:36.329061 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:36.329146 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:36.329425 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:36.329428 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:36.329430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:36.329668 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:36.329809 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:36.330062 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 05:06:36.330183 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 05:06:36.333182 7244 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52856:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:06:36.336194 7244 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:06:36.350272 7756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.344602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:36669 (local address 127.0.0.1:36616)
0811 05:06:36.345376 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:36.345427 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:36.345567 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:36.346377 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:36.346383 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:36.346406 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:36.346553 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.346564 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.347734 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.347740 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.348886 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.348896 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.349728 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.349734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.349851 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.349898 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 05:06:36.350009 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 05:06:36.350126 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":83,"threads_started":1}
I20260811 05:06:36.350312 7758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.344743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36616 (local address 127.22.49.193:36669)
0811 05:06:36.345857 (+ 1114us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:36.345871 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:36.345891 (+ 20us) server_negotiation.cc:407] Connection header received
0811 05:06:36.346001 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:36.346007 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:36.346211 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:36.346366 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:36.346693 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.347594 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.349011 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.349606 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.349718 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.349871 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:36.350054 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 05:06:36.350151 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1022,"thread_start_us":92,"threads_started":1}
I20260811 05:06:36.351121 7759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.344678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38389 (local address 127.0.0.1:40714)
0811 05:06:36.345456 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:36.345473 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:36.345567 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:36.346566 (+ 999us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:36.346571 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:36.346591 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:36.346679 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.346685 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.348085 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.348088 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.349438 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.349455 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.350656 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.350659 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.350775 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.350798 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 05:06:36.350869 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 05:06:36.350948 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"mutex_wait_us":71,"thread_start_us":125,"threads_started":1}
I20260811 05:06:36.351327 7757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.344947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:40453 (local address 127.0.0.1:56816)
0811 05:06:36.345777 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:36.345804 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:36.345888 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:36.346814 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:36.346816 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:36.346833 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:36.346911 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.346916 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.348418 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.348421 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.349688 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.349699 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.350755 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.350758 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.350866 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.350885 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 05:06:36.351121 (+ 236us) client_negotiation.cc:240] Negotiation successful
0811 05:06:36.351209 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":773,"mutex_wait_us":87,"thread_start_us":75,"threads_started":1}
I20260811 05:06:36.351806 7760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.345388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56816 (local address 127.22.49.195:40453)
0811 05:06:36.346186 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:36.346194 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:36.346213 (+ 19us) server_negotiation.cc:407] Connection header received
0811 05:06:36.346274 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:36.346277 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:36.346499 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:36.346656 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:36.347063 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.348276 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.349819 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.350635 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.350755 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.350894 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:36.351551 (+ 657us) server_negotiation.cc:299] Negotiation successful
0811 05:06:36.351660 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":104,"threads_started":1}
I20260811 05:06:36.352548 7761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.345754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40714 (local address 127.22.49.194:38389)
0811 05:06:36.346117 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:36.346128 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:36.346147 (+ 19us) server_negotiation.cc:407] Connection header received
0811 05:06:36.346212 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:36.346217 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:36.346376 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:36.346523 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:36.346803 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.347930 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.349577 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.350375 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.350479 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.350601 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:36.351699 (+ 1098us) server_negotiation.cc:299] Negotiation successful
0811 05:06:36.351789 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":160,"threads_started":1}
I20260811 05:06:36.353688 7381 tablet_service.cc:1467] Processing CreateTablet for tablet b31bda14f1554e9ab405606eab7050d2 (DEFAULT_TABLE table=test-table [id=a1d5cfe0ce6c42eea7242ada6dc0c568]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:06:36.354092 7671 tablet_service.cc:1467] Processing CreateTablet for tablet b31bda14f1554e9ab405606eab7050d2 (DEFAULT_TABLE table=test-table [id=a1d5cfe0ce6c42eea7242ada6dc0c568]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:06:36.354848 7381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b31bda14f1554e9ab405606eab7050d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:36.355077 7671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b31bda14f1554e9ab405606eab7050d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:36.355014 7525 tablet_service.cc:1467] Processing CreateTablet for tablet b31bda14f1554e9ab405606eab7050d2 (DEFAULT_TABLE table=test-table [id=a1d5cfe0ce6c42eea7242ada6dc0c568]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:06:36.355903 7525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b31bda14f1554e9ab405606eab7050d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:36.361094 7762 tablet_bootstrap.cc:492] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9: Bootstrap starting.
I20260811 05:06:36.362958 7765 tablet_bootstrap.cc:492] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1: Bootstrap starting.
I20260811 05:06:36.363324 7764 tablet_bootstrap.cc:492] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: Bootstrap starting.
I20260811 05:06:36.363740 7762 tablet_bootstrap.cc:654] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:36.364446 7762 log.cc:824] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:36.365154 7764 tablet_bootstrap.cc:654] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:36.365556 7765 tablet_bootstrap.cc:654] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:36.366429 7765 log.cc:824] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:36.366770 7762 tablet_bootstrap.cc:492] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9: No bootstrap required, opened a new log
I20260811 05:06:36.367035 7762 ts_tablet_manager.cc:1397] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260811 05:06:36.367244 7764 log.cc:824] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:36.368325 7765 tablet_bootstrap.cc:492] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1: No bootstrap required, opened a new log
I20260811 05:06:36.368501 7765 ts_tablet_manager.cc:1397] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260811 05:06:36.369259 7764 tablet_bootstrap.cc:492] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: No bootstrap required, opened a new log
I20260811 05:06:36.369436 7764 ts_tablet_manager.cc:1397] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 05:06:36.370563 7762 raft_consensus.cc:348] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } } peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } }
I20260811 05:06:36.370812 7762 raft_consensus.cc:374] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:36.370887 7762 raft_consensus.cc:729] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4078da34cd9943a48816009d38f299b9, State: Initialized, Role: FOLLOWER
I20260811 05:06:36.371378 7762 consensus_queue.cc:260] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } } peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } }
I20260811 05:06:36.372116 7743 heartbeater.cc:503] Master 127.22.49.254:35753 was elected leader, sending a full tablet report...
I20260811 05:06:36.372327 7765 raft_consensus.cc:348] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } } peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } }
I20260811 05:06:36.372648 7765 raft_consensus.cc:374] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:36.372745 7765 raft_consensus.cc:729] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257bcb3589484ef2b7b7cba8be9789d1, State: Initialized, Role: FOLLOWER
I20260811 05:06:36.373250 7765 consensus_queue.cc:260] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } } peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } }
I20260811 05:06:36.373170 7764 raft_consensus.cc:348] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } } peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } }
I20260811 05:06:36.373394 7764 raft_consensus.cc:374] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:36.373410 7762 ts_tablet_manager.cc:1428] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 05:06:36.373535 7764 raft_consensus.cc:729] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d22b1610e024f3abcb45f0312963ac7, State: Initialized, Role: FOLLOWER
I20260811 05:06:36.373998 7596 heartbeater.cc:503] Master 127.22.49.254:35753 was elected leader, sending a full tablet report...
I20260811 05:06:36.374020 7764 consensus_queue.cc:260] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } } peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } }
I20260811 05:06:36.374259 7765 ts_tablet_manager.cc:1428] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260811 05:06:36.374953 7764 ts_tablet_manager.cc:1428] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260811 05:06:36.375206 7449 heartbeater.cc:503] Master 127.22.49.254:35753 was elected leader, sending a full tablet report...
I20260811 05:06:36.384521 7769 raft_consensus.cc:482] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:06:36.384680 7769 raft_consensus.cc:504] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } } peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } }
I20260811 05:06:36.385766 7769 leader_election.cc:288] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d22b1610e024f3abcb45f0312963ac7 (127.22.49.193:36669), 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389)
I20260811 05:06:36.389290 7745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.386002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38389 (local address 127.22.49.195:35427)
0811 05:06:36.386139 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:36.386157 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:36.386241 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:36.386536 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:36.386539 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:36.386556 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:36.386672 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.386677 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.387464 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.387469 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.388224 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.388233 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.388878 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.388882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.388992 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.389009 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 05:06:36.389094 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 05:06:36.389163 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 05:06:36.389290 7761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.386203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:35427 (local address 127.22.49.194:38389)
0811 05:06:36.386339 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:36.386343 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:36.386355 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:06:36.386401 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:36.386402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:36.386438 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:36.386522 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:36.386782 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.387356 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.388349 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.388751 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.388877 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.388928 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:36.389110 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 05:06:36.389173 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 05:06:36.390087 7772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.386024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:36669 (local address 127.22.49.195:45101)
0811 05:06:36.386472 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:36.386484 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:36.386620 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:36.386903 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:36.386906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:36.386923 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:36.387083 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.387090 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.387847 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.387854 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.388663 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.388672 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.389547 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.389551 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.389697 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.389733 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 05:06:36.389829 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 05:06:36.389921 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":200,"threads_started":1}
I20260811 05:06:36.390097 7758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.386148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:45101 (local address 127.22.49.193:36669)
0811 05:06:36.386289 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:36.386295 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:36.386576 (+ 281us) server_negotiation.cc:407] Connection header received
0811 05:06:36.386734 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:36.386740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:36.386799 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:36.386893 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:36.387205 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.387720 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.388808 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.389373 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.389503 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.389560 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:36.389905 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 05:06:36.389988 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 05:06:36.390166 7547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b31bda14f1554e9ab405606eab7050d2" candidate_uuid: "4078da34cd9943a48816009d38f299b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257bcb3589484ef2b7b7cba8be9789d1" is_pre_election: true
I20260811 05:06:36.390249 7771 raft_consensus.cc:482] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:06:36.390400 7771 raft_consensus.cc:504] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } } peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } }
I20260811 05:06:36.390491 7547 raft_consensus.cc:2454] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4078da34cd9943a48816009d38f299b9 in term 0.
I20260811 05:06:36.390942 7401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b31bda14f1554e9ab405606eab7050d2" candidate_uuid: "4078da34cd9943a48816009d38f299b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d22b1610e024f3abcb45f0312963ac7" is_pre_election: true
I20260811 05:06:36.391067 7622 leader_election.cc:302] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257bcb3589484ef2b7b7cba8be9789d1, 4078da34cd9943a48816009d38f299b9; no voters:
I20260811 05:06:36.391353 7769 raft_consensus.cc:2781] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:06:36.391459 7769 raft_consensus.cc:482] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:06:36.391511 7769 raft_consensus.cc:3037] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:36.391522 7401 raft_consensus.cc:2454] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4078da34cd9943a48816009d38f299b9 in term 0.
I20260811 05:06:36.392195 7771 leader_election.cc:288] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389), 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453)
I20260811 05:06:36.392949 7769 raft_consensus.cc:504] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } } peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } }
I20260811 05:06:36.393292 7769 leader_election.cc:288] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2d22b1610e024f3abcb45f0312963ac7 (127.22.49.193:36669), 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389)
I20260811 05:06:36.393584 7401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b31bda14f1554e9ab405606eab7050d2" candidate_uuid: "4078da34cd9943a48816009d38f299b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d22b1610e024f3abcb45f0312963ac7"
I20260811 05:06:36.393621 7547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b31bda14f1554e9ab405606eab7050d2" candidate_uuid: "4078da34cd9943a48816009d38f299b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257bcb3589484ef2b7b7cba8be9789d1"
I20260811 05:06:36.393718 7401 raft_consensus.cc:3037] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:36.393744 7547 raft_consensus.cc:3037] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:36.395112 7547 raft_consensus.cc:2454] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4078da34cd9943a48816009d38f299b9 in term 1.
I20260811 05:06:36.395174 7401 raft_consensus.cc:2454] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4078da34cd9943a48816009d38f299b9 in term 1.
I20260811 05:06:36.395428 7622 leader_election.cc:302] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257bcb3589484ef2b7b7cba8be9789d1, 4078da34cd9943a48816009d38f299b9; no voters:
I20260811 05:06:36.395601 7769 raft_consensus.cc:2781] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:06:36.395813 7769 raft_consensus.cc:686] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [term 1 LEADER]: Becoming Leader. State: Replica: 4078da34cd9943a48816009d38f299b9, State: Running, Role: LEADER
I20260811 05:06:36.396138 7769 consensus_queue.cc:237] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } } peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } }
I20260811 05:06:36.396821 7760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.392646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:36023 (local address 127.22.49.195:40453)
0811 05:06:36.392768 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:36.392773 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:36.392835 (+ 62us) server_negotiation.cc:407] Connection header received
0811 05:06:36.392970 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:36.392973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:36.393009 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:36.393097 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:36.393393 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.394053 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.395589 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.396162 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.396251 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.396294 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:36.396633 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 05:06:36.396712 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 05:06:36.397146 7774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.392395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:40453 (local address 127.22.49.193:36023)
0811 05:06:36.392760 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:36.392777 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:36.392876 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:36.393108 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:36.393111 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:36.393127 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:36.393240 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.393246 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.394198 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.394201 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.395452 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.395463 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.396393 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.396396 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.396493 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.396516 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 05:06:36.396938 (+ 422us) client_negotiation.cc:240] Negotiation successful
0811 05:06:36.397011 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":113,"threads_started":1}
I20260811 05:06:36.397652 7693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b31bda14f1554e9ab405606eab7050d2" candidate_uuid: "2d22b1610e024f3abcb45f0312963ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4078da34cd9943a48816009d38f299b9" is_pre_election: true
I20260811 05:06:36.397804 7761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.392537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:48709 (local address 127.22.49.194:38389)
0811 05:06:36.392795 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:36.392802 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:36.393838 (+ 1036us) server_negotiation.cc:407] Connection header received
0811 05:06:36.394044 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:36.394047 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:36.394099 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:36.394152 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:36.394596 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.395297 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.396629 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.397098 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.397239 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.397290 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:36.397623 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 05:06:36.397690 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160}
I20260811 05:06:36.397835 7773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.392395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38389 (local address 127.22.49.193:48709)
0811 05:06:36.393738 (+ 1343us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:36.393755 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:36.393909 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:36.394288 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:36.394291 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:36.394308 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:36.394459 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.394467 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.395456 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.395463 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.396447 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:36.396457 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.397224 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.397229 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:36.397488 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.397508 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 05:06:36.397609 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 05:06:36.397675 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1261,"mutex_wait_us":52,"thread_start_us":98,"threads_started":1}
I20260811 05:06:36.399190 7547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b31bda14f1554e9ab405606eab7050d2" candidate_uuid: "2d22b1610e024f3abcb45f0312963ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257bcb3589484ef2b7b7cba8be9789d1" is_pre_election: true
I20260811 05:06:36.399384 7547 raft_consensus.cc:2379] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d22b1610e024f3abcb45f0312963ac7 in current term 1: Already voted for candidate 4078da34cd9943a48816009d38f299b9 in this term.
I20260811 05:06:36.399832 7331 leader_election.cc:302] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d22b1610e024f3abcb45f0312963ac7; no voters: 257bcb3589484ef2b7b7cba8be9789d1, 4078da34cd9943a48816009d38f299b9
I20260811 05:06:36.400127 7771 raft_consensus.cc:2726] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 05:06:36.399869 7244 catalog_manager.cc:5495] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4078da34cd9943a48816009d38f299b9 (127.22.49.195). New cstate: current_term: 1 leader_uuid: "4078da34cd9943a48816009d38f299b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } health_report { overall_health: HEALTHY } } }
I20260811 05:06:36.414034 7760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.410310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56828 (local address 127.22.49.195:40453)
0811 05:06:36.410458 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:36.410461 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:36.410476 (+ 15us) server_negotiation.cc:407] Connection header received
0811 05:06:36.410608 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:36.410610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:36.410663 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:36.410749 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:06:36.411076 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.411591 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.412501 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:36.412710 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:36.412791 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:36.413172 (+ 381us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:06:36.413634 (+ 462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:06:36.413735 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:36.413880 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 05:06:36.413928 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 05:06:36.419888 7547 raft_consensus.cc:1261] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1 [term 1 FOLLOWER]: Refusing update from remote peer 4078da34cd9943a48816009d38f299b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:06:36.419934 7401 raft_consensus.cc:1261] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Refusing update from remote peer 4078da34cd9943a48816009d38f299b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:06:36.420580 7769 consensus_queue.cc:1035] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:06:36.420831 7775 consensus_queue.cc:1035] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:06:36.430773 7779 mvcc.cc:205] Tried to move back new op lower bound from 7317195966128832512 to 7317195966041849856. Current Snapshot: MvccSnapshot[applied={T|T < 7317195966128832512}]
I20260811 05:06:36.437096 7244 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:06:36.437309 7244 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:06:36.440145 7244 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Sending DeleteTablet for 3 replicas of tablet b31bda14f1554e9ab405606eab7050d2
I20260811 05:06:36.441038 7671 tablet_service.cc:1514] Processing DeleteTablet for tablet b31bda14f1554e9ab405606eab7050d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:36 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:56816
I20260811 05:06:36.441076 7525 tablet_service.cc:1514] Processing DeleteTablet for tablet b31bda14f1554e9ab405606eab7050d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:36 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:40714
I20260811 05:06:36.441605 7789 tablet_replica.cc:330] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9: stopping tablet replica
I20260811 05:06:36.441648 7790 tablet_replica.cc:330] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1: stopping tablet replica
I20260811 05:06:36.441699 7381 tablet_service.cc:1514] Processing DeleteTablet for tablet b31bda14f1554e9ab405606eab7050d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:36 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:36616
I20260811 05:06:36.442027 7790 raft_consensus.cc:2229] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:06:36.442140 7789 raft_consensus.cc:2229] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:06:36.442559 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 7311
I20260811 05:06:36.442574 7789 raft_consensus.cc:2258] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:06:36.442567 7790 raft_consensus.cc:2258] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:06:36.446050 7790 ts_tablet_manager.cc:1905] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:06:36.446376 7789 ts_tablet_manager.cc:1905] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:06:36.449069 7790 ts_tablet_manager.cc:1918] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:06:36.449263 7790 log.cc:1196] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/b31bda14f1554e9ab405606eab7050d2
I20260811 05:06:36.449694 7790 ts_tablet_manager.cc:1939] T b31bda14f1554e9ab405606eab7050d2 P 257bcb3589484ef2b7b7cba8be9789d1: Deleting consensus metadata
I20260811 05:06:36.449980 7789 ts_tablet_manager.cc:1918] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:06:36.450161 7789 log.cc:1196] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/b31bda14f1554e9ab405606eab7050d2
I20260811 05:06:36.450589 7789 ts_tablet_manager.cc:1939] T b31bda14f1554e9ab405606eab7050d2 P 4078da34cd9943a48816009d38f299b9: Deleting consensus metadata
I20260811 05:06:36.451309 7229 catalog_manager.cc:4841] TS 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389): tablet b31bda14f1554e9ab405606eab7050d2 (table test-table [id=a1d5cfe0ce6c42eea7242ada6dc0c568]) successfully deleted
I20260811 05:06:36.451877 7230 catalog_manager.cc:4841] TS 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453): tablet b31bda14f1554e9ab405606eab7050d2 (table test-table [id=a1d5cfe0ce6c42eea7242ada6dc0c568]) successfully deleted
W20260811 05:06:36.452275 7228 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:36669 (error 108)
I20260811 05:06:36.453270 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 7456
I20260811 05:06:36.453481 7756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:36.453117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:36669 (local address 127.0.0.1:36620)
0811 05:06:36.453287 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:36.453376 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:36669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260811 05:06:36.455447 7228 catalog_manager.cc:4584] TS 2d22b1610e024f3abcb45f0312963ac7 (127.22.49.193:36669): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b31bda14f1554e9ab405606eab7050d2: Network error: Client connection negotiation failed: client connection to 127.22.49.193:36669: connect: Connection refused (error 111)
I20260811 05:06:36.463244 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 7602
I20260811 05:06:36.471850 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 7209
I20260811 05:06:56.481590 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:35753
--webserver_interface=127.22.49.254
--webserver_port=41509
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:35753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:06:56.598469 7793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:56.598809 7793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:56.598897 7793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:56.602900 7793 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 05:06:56.602993 7793 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 05:06:56.603044 7793 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 05:06:56.603075 7793 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:06:56.603108 7793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:56.603152 7793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:56.603188 7793 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:06:56.603226 7793 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:06:56.608608 7793 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:35753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:35753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=41509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:56.609736 7793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:56.610790 7793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:56.625434 7803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:56.625406 7800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:56.625612 7793 server_base.cc:1034] running on GCE node
W20260811 05:06:56.625406 7801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:56.626543 7793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:56.627820 7793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:56.629031 7793 hybrid_clock.cc:648] HybridClock initialized: now 1786424816629005 us; error 38 us; skew 500 ppm
Aug 11 05:06:56 dist-test-slave-w206 krb5kdc[7193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424816, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:56.637390 7793 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:06:56.638396 7793 webserver.cc:460] Webserver started at http://127.22.49.254:41509/ using document root <none> and password file <none>
I20260811 05:06:56.639101 7793 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:56.639215 7793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:56.643270 7793 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:06:56.645560 7810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:56.646770 7793 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:06:56.646931 7793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "dd811024b65f4ed7b535aaab06bb0b83"
format_stamp: "Formatted at 2026-08-11 05:06:35 on dist-test-slave-w206"
server_key: "f19f4bbf30264aecc7a732684838545a"
server_key_iv: "5b6e38d35b5bffc6e66293329dbe4a28"
server_key_version: "encryptionkey@0"
I20260811 05:06:56.647629 7793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:56.672128 7793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:56.675125 7793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:56.675338 7793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:56.683343 7793 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:35753
I20260811 05:06:56.683681 7869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:35753 every 8 connection(s)
I20260811 05:06:56.684489 7793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:06:56.688875 7870 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:06:56.689965 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 7793
I20260811 05:06:56.690452 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:36669
--local_ip_for_outbound_sockets=127.22.49.193
--tserver_master_addrs=127.22.49.254:35753
--webserver_port=37555
--webserver_interface=127.22.49.193
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:06:56.690601 7870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Bootstrap starting.
I20260811 05:06:56.708263 7870 log.cc:824] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:56.717300 7870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:06:56.717722 7870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Bootstrap complete.
I20260811 05:06:56.722020 7870 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } }
I20260811 05:06:56.722496 7870 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd811024b65f4ed7b535aaab06bb0b83, State: Initialized, Role: FOLLOWER
I20260811 05:06:56.723034 7870 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } }
I20260811 05:06:56.723167 7870 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:06:56.723260 7870 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:06:56.723361 7870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 1 FOLLOWER]: Advancing to term 2
I20260811 05:06:56.725313 7870 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } }
I20260811 05:06:56.725696 7870 leader_election.cc:302] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd811024b65f4ed7b535aaab06bb0b83; no voters:
I20260811 05:06:56.726130 7870 leader_election.cc:288] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 05:06:56.726204 7874 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 05:06:56.726445 7874 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 2 LEADER]: Becoming Leader. State: Replica: dd811024b65f4ed7b535aaab06bb0b83, State: Running, Role: LEADER
I20260811 05:06:56.726807 7874 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } }
I20260811 05:06:56.727442 7870 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:06:56.728688 7875 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "dd811024b65f4ed7b535aaab06bb0b83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } } }
I20260811 05:06:56.728821 7875 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:56.729063 7876 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd811024b65f4ed7b535aaab06bb0b83. Latest consensus state: current_term: 2 leader_uuid: "dd811024b65f4ed7b535aaab06bb0b83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } } }
I20260811 05:06:56.729147 7876 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [sys.catalog]: This master's current role is: LEADER
I20260811 05:06:56.730023 7884 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:06:56.734864 7884 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:06:56.735536 7884 catalog_manager.cc:1259] Loaded cluster ID: e36604a7abba423fa43c5bcd61a970ff
I20260811 05:06:56.735599 7884 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:06:56.738111 7884 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:06:56.738814 7884 catalog_manager.cc:5879] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Loaded TSK: 0
I20260811 05:06:56.756129 7884 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Generated new TSK 1
I20260811 05:06:56.756384 7884 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 05:06:56.811347 7872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:56.811633 7872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:56.811715 7872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:56.815768 7872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:56.815850 7872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:56.815935 7872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:06:56.821745 7872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:36669
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=37555
--tserver_master_addrs=127.22.49.254:35753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:56.822731 7872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:56.823819 7872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:56.835039 7900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:56.835012 7903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:56.835003 7901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:56.835362 7872 server_base.cc:1034] running on GCE node
I20260811 05:06:56.835816 7872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:56.836613 7872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:56.837824 7872 hybrid_clock.cc:648] HybridClock initialized: now 1786424816837800 us; error 33 us; skew 500 ppm
Aug 11 05:06:56 dist-test-slave-w206 krb5kdc[7193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424816, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:56.841219 7872 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:06:56.842206 7872 webserver.cc:460] Webserver started at http://127.22.49.193:37555/ using document root <none> and password file <none>
I20260811 05:06:56.842761 7872 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:56.842868 7872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:56.846961 7872 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:06:56.849382 7910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:56.850775 7872 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 05:06:56.850900 7872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "2d22b1610e024f3abcb45f0312963ac7"
format_stamp: "Formatted at 2026-08-11 05:06:35 on dist-test-slave-w206"
server_key: "a43eac48e9b0c0bc58f6aa727fdb36cb"
server_key_iv: "124b7e9c439282ebe4559daaeed8e8ed"
server_key_version: "encryptionkey@0"
I20260811 05:06:56.851508 7872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:56.885187 7872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:56.889050 7872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:56.889288 7872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:56.889979 7872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:56.891265 7917 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 05:06:56.895350 7872 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 05:06:56.895459 7872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260811 05:06:56.895565 7872 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 05:06:56.897212 7872 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 05:06:56.897295 7872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 05:06:56.897568 7917 tablet_bootstrap.cc:492] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: Bootstrap starting.
I20260811 05:06:56.908676 7872 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:36669
I20260811 05:06:56.908789 8035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:36669 every 8 connection(s)
I20260811 05:06:56.909698 7872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:06:56.916234 7917 log.cc:824] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:56.919080 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 7872
I20260811 05:06:56.919638 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:38389
--local_ip_for_outbound_sockets=127.22.49.194
--tserver_master_addrs=127.22.49.254:35753
--webserver_port=36559
--webserver_interface=127.22.49.194
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:06:56 dist-test-slave-w206 krb5kdc[7193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424816, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:56.925730 7917 tablet_bootstrap.cc:492] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:06:56.926231 7917 tablet_bootstrap.cc:492] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: Bootstrap complete.
I20260811 05:06:56.927893 7917 ts_tablet_manager.cc:1397] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: Time spent bootstrapping tablet: real 0.031s user 0.025s sys 0.004s
I20260811 05:06:56.928200 8040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:56.911972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:49503)
0811 05:06:56.912472 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:56.912515 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:56.913377 (+ 862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:56.914484 (+ 1107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:56.914491 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:56.914909 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:56.915433 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:56.915446 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:56.916813 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:56.916816 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:56.917648 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:56.917657 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:56.918390 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:56.918393 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:56.918594 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:56.919345 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:56.919370 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:56.921303 (+ 1933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:56.924025 (+ 2722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:56.924031 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:56.924043 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:56.924299 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:56.924664 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:56.924668 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:56.924670 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:56.924816 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:56.925441 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:56.925447 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:56.925685 (+ 238us) client_negotiation.cc:769] Sending connection context
0811 05:06:56.925866 (+ 181us) client_negotiation.cc:240] Negotiation successful
0811 05:06:56.926236 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":144,"threads_started":1}
I20260811 05:06:56.928843 8038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:56.911862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:49503 (local address 127.22.49.254:35753)
0811 05:06:56.912224 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:56.912265 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:56.912679 (+ 414us) server_negotiation.cc:407] Connection header received
0811 05:06:56.913819 (+ 1140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:56.913828 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:56.914117 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:56.914432 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:56.915612 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:56.916655 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:56.917784 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:56.918242 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:56.918426 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:56.921542 (+ 3116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:56.921549 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:56.921566 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:56.921606 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:56.923893 (+ 2287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:56.924428 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:56.924434 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:56.924441 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:56.924562 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:56.924915 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:56.924919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:56.924920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:56.925324 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:56.925477 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:56.926493 (+ 1016us) server_negotiation.cc:299] Negotiation successful
0811 05:06:56.926779 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":127,"threads_started":1}
I20260811 05:06:56.931139 8036 heartbeater.cc:347] Connected to a master server at 127.22.49.254:35753
I20260811 05:06:56.931377 8036 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:56.931871 8036 heartbeater.cc:511] Master 127.22.49.254:35753 requested a full tablet report, sending...
I20260811 05:06:56.931826 7917 raft_consensus.cc:348] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } } peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } }
I20260811 05:06:56.932507 7917 raft_consensus.cc:729] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d22b1610e024f3abcb45f0312963ac7, State: Initialized, Role: FOLLOWER
I20260811 05:06:56.933056 7917 consensus_queue.cc:260] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } } peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } }
I20260811 05:06:56.934322 7917 ts_tablet_manager.cc:1428] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 05:06:56.935909 7831 ts_manager.cc:194] Registered new tserver with Master: 2d22b1610e024f3abcb45f0312963ac7 (127.22.49.193:36669)
I20260811 05:06:56.939260 7831 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:49503
I20260811 05:06:56.941459 8036 heartbeater.cc:503] Master 127.22.49.254:35753 was elected leader, sending a full tablet report...
Aug 11 05:06:56 dist-test-slave-w206 krb5kdc[7193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424816, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for kudu/127.22.49.193@KRBTEST.COM
I20260811 05:06:56.951804 8044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:56.938682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:36669 (local address 127.0.0.1:34158)
0811 05:06:56.939411 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:56.939465 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:56.939599 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:56.940164 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:56.940170 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:56.941967 (+ 1797us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:56.942108 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:56.942117 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:56.943398 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:56.943402 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:56.944398 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:56.944420 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:56.945070 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:56.945073 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:56.945197 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:56.945769 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:56.945786 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:56.947573 (+ 1787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:56.949681 (+ 2108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:56.949694 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:56.949700 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:56.949971 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:56.950315 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:56.950320 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:56.950322 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:56.950422 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:56.951001 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:56.951008 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:56.951151 (+ 143us) client_negotiation.cc:769] Sending connection context
0811 05:06:56.951318 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 05:06:56.951591 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":116,"threads_started":1}
I20260811 05:06:56.951804 8045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:56.938762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34158 (local address 127.22.49.193:36669)
0811 05:06:56.939155 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:56.939166 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:56.939562 (+ 396us) server_negotiation.cc:407] Connection header received
0811 05:06:56.939746 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:56.939752 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:56.939948 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:56.940098 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:56.942242 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:56.943293 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:56.944558 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:56.944947 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:56.945048 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:56.947729 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:56.947752 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:56.947764 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:56.947792 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:56.949551 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:56.950104 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:56.950115 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:56.950116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:56.950200 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:56.950526 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:56.950531 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:56.950533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:56.950855 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:56.951031 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:56.951443 (+ 412us) server_negotiation.cc:299] Negotiation successful
0811 05:06:56.951619 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":88,"threads_started":1}
I20260811 05:06:56.953218 7962 tablet_service.cc:1514] Processing DeleteTablet for tablet b31bda14f1554e9ab405606eab7050d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:36 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:34158
I20260811 05:06:56.954205 8046 tablet_replica.cc:330] stopping tablet replica
I20260811 05:06:56.954525 8046 raft_consensus.cc:2229] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:06:56.954788 8046 raft_consensus.cc:2258] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:06:56.955875 8046 ts_tablet_manager.cc:1905] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:06:56.959824 8046 ts_tablet_manager.cc:1918] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:06:56.959914 8046 log.cc:1196] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal/wals/b31bda14f1554e9ab405606eab7050d2
I20260811 05:06:56.960258 8046 ts_tablet_manager.cc:1939] T b31bda14f1554e9ab405606eab7050d2 P 2d22b1610e024f3abcb45f0312963ac7: Deleting consensus metadata
I20260811 05:06:56.962095 7814 catalog_manager.cc:4841] TS 2d22b1610e024f3abcb45f0312963ac7 (127.22.49.193:36669): tablet b31bda14f1554e9ab405606eab7050d2 (table test-table [id=a1d5cfe0ce6c42eea7242ada6dc0c568]) successfully deleted
W20260811 05:06:57.040977 8042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:57.041268 8042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:57.041342 8042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:57.045389 8042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:57.045477 8042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:57.045569 8042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:06:57.050868 8042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:38389
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=36559
--tserver_master_addrs=127.22.49.254:35753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:57.052007 8042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:57.053028 8042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:57.062845 8052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:57.062861 8051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:57.062907 8042 server_base.cc:1034] running on GCE node
W20260811 05:06:57.062852 8054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:57.063583 8042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:57.064160 8042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:57.065356 8042 hybrid_clock.cc:648] HybridClock initialized: now 1786424817065324 us; error 53 us; skew 500 ppm
Aug 11 05:06:57 dist-test-slave-w206 krb5kdc[7193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424817, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:57.068148 8042 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:06:57.069024 8042 webserver.cc:460] Webserver started at http://127.22.49.194:36559/ using document root <none> and password file <none>
I20260811 05:06:57.069587 8042 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:57.069700 8042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:57.073654 8042 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:06:57.075670 8061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:57.076906 8042 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:06:57.077042 8042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "257bcb3589484ef2b7b7cba8be9789d1"
format_stamp: "Formatted at 2026-08-11 05:06:36 on dist-test-slave-w206"
server_key: "98d0a00b1f8c462d45ca53d7113bc0a0"
server_key_iv: "45dc1459a07b2781a1c586a15063f20e"
server_key_version: "encryptionkey@0"
I20260811 05:06:57.077589 8042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:57.106686 8042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:57.109871 8042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:57.110092 8042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:57.110713 8042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:57.111619 8042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:57.111691 8042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:57.111764 8042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:57.111816 8042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:57.121109 8042 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:38389
I20260811 05:06:57.121130 8185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:38389 every 8 connection(s)
I20260811 05:06:57.122208 8042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:06:57.129729 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 8042
I20260811 05:06:57.130285 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:40453
--local_ip_for_outbound_sockets=127.22.49.195
--tserver_master_addrs=127.22.49.254:35753
--webserver_port=44973
--webserver_interface=127.22.49.195
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 05:06:57 dist-test-slave-w206 krb5kdc[7193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424817, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:57.137197 8038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.124073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:58415 (local address 127.22.49.254:35753)
0811 05:06:57.124210 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:57.124213 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:57.125488 (+ 1275us) server_negotiation.cc:407] Connection header received
0811 05:06:57.126488 (+ 1000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:57.126491 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:57.126547 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:57.126623 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:57.127828 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.128438 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.129627 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.129978 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.130106 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.132858 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:57.132867 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:57.132869 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:57.132893 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:57.134423 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:57.135082 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:57.135088 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:57.135093 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:57.135201 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:57.135758 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:57.135763 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:57.135767 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:57.136056 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:57.136175 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:57.136767 (+ 592us) server_negotiation.cc:299] Negotiation successful
0811 05:06:57.136953 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 05:06:57.138147 8188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.124396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:58415)
0811 05:06:57.125304 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:57.125357 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:57.126197 (+ 840us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:57.126754 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:57.126760 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:57.127212 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:57.127693 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:57.127705 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.128549 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.128551 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:57.129481 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:57.129491 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.130132 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.130135 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:57.130273 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.130936 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:57.130952 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:57.132677 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:57.134552 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:57.134558 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:57.134574 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:57.134949 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:57.135468 (+ 519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:57.135471 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:57.135472 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:57.135637 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:57.136179 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:57.136185 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:57.136494 (+ 309us) client_negotiation.cc:769] Sending connection context
0811 05:06:57.136653 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 05:06:57.136965 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":700,"thread_start_us":561,"threads_started":1}
I20260811 05:06:57.139523 8186 heartbeater.cc:347] Connected to a master server at 127.22.49.254:35753
I20260811 05:06:57.139789 8186 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:57.140307 8186 heartbeater.cc:511] Master 127.22.49.254:35753 requested a full tablet report, sending...
I20260811 05:06:57.141426 7831 ts_manager.cc:194] Registered new tserver with Master: 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389)
I20260811 05:06:57.142017 7831 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:58415
W20260811 05:06:57.245795 8189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:06:57.246151 8189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:06:57.246246 8189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:06:57.250541 8189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:06:57.250658 8189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:06:57.250774 8189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:06:57.256616 8189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:40453
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=44973
--tserver_master_addrs=127.22.49.254:35753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:06:57.257736 8189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:06:57.258834 8189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:06:57.268536 8194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:57.268723 8189 server_base.cc:1034] running on GCE node
W20260811 05:06:57.268937 8195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:06:57.268947 8197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:06:57.269482 8189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:06:57.270169 8189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:06:57.271354 8189 hybrid_clock.cc:648] HybridClock initialized: now 1786424817271330 us; error 37 us; skew 500 ppm
Aug 11 05:06:57 dist-test-slave-w206 krb5kdc[7193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424817, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:06:57.274194 8189 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:06:57.275079 8189 webserver.cc:460] Webserver started at http://127.22.49.195:44973/ using document root <none> and password file <none>
I20260811 05:06:57.275599 8189 fs_manager.cc:359] Metadata directory not provided
I20260811 05:06:57.275671 8189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:06:57.279542 8189 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:06:57.281697 8204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:57.282903 8189 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:06:57.283167 8189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "4078da34cd9943a48816009d38f299b9"
format_stamp: "Formatted at 2026-08-11 05:06:36 on dist-test-slave-w206"
server_key: "ae910609bfe6da3459c3cd49ac84c9dc"
server_key_iv: "9cc962b436411b759197675f45cb777e"
server_key_version: "encryptionkey@0"
I20260811 05:06:57.283694 8189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:06:57.307060 8189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:06:57.310402 8189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:06:57.310670 8189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:06:57.311311 8189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:06:57.312142 8189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:06:57.312189 8189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:57.312258 8189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:06:57.312291 8189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:06:57.321501 8189 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:40453
I20260811 05:06:57.321565 8326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:40453 every 8 connection(s)
I20260811 05:06:57.322592 8189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:06:57.328485 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 8189
Aug 11 05:06:57 dist-test-slave-w206 krb5kdc[7193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424817, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:06:57.337204 8332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.329334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58046 (local address 127.22.49.254:35753)
0811 05:06:57.329557 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:57.329563 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:57.329576 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:06:57.329669 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:57.329672 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:57.329718 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:57.329824 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:57.330638 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.331212 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.332045 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.332269 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.332371 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.333829 (+ 1458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:57.333835 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:57.333840 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:57.333882 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:57.335527 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:57.335948 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:57.335951 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:57.335953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:57.336035 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:57.336308 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:57.336312 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:57.336314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:57.336490 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:57.336703 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:57.336835 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 05:06:57.336971 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":69,"threads_started":1}
I20260811 05:06:57.337236 8038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.324405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:47193 (local address 127.22.49.254:35753)
0811 05:06:57.324546 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:57.324549 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:57.325390 (+ 841us) server_negotiation.cc:407] Connection header received
0811 05:06:57.326729 (+ 1339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:57.326733 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:57.326796 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:57.326897 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:57.328395 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.329136 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.330481 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.330716 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.330824 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.333454 (+ 2630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:57.333456 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:57.333458 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:57.333480 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:57.335132 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:57.335653 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:57.335658 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:57.335659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:57.335746 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:57.336095 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:57.336100 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:57.336102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:57.336281 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:57.336392 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:57.336887 (+ 495us) server_negotiation.cc:299] Negotiation successful
0811 05:06:57.337070 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":56}
I20260811 05:06:57.338176 8330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.324823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:47193)
0811 05:06:57.325248 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:57.325289 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:57.326503 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:57.327191 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:57.327198 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:57.327654 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:06:57.328211 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:57.328231 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.329270 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.329273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:57.330343 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:57.330354 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.330875 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.330880 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:57.331065 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.331674 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:06:57.331690 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:06:57.333264 (+ 1574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:06:57.335254 (+ 1990us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:57.335267 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:57.335279 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:57.335545 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:57.335850 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:06:57.335853 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:06:57.335855 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:06:57.335996 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:06:57.336389 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:06:57.336396 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:06:57.336643 (+ 247us) client_negotiation.cc:769] Sending connection context
0811 05:06:57.336832 (+ 189us) client_negotiation.cc:240] Negotiation successful
0811 05:06:57.337163 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":119,"threads_started":1}
I20260811 05:06:57.339322 8327 heartbeater.cc:347] Connected to a master server at 127.22.49.254:35753
I20260811 05:06:57.339569 8327 heartbeater.cc:464] Registering TS with master...
I20260811 05:06:57.340070 8327 heartbeater.cc:511] Master 127.22.49.254:35753 requested a full tablet report, sending...
I20260811 05:06:57.341049 7831 ts_manager.cc:194] Registered new tserver with Master: 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453)
I20260811 05:06:57.341599 7831 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:47193
I20260811 05:06:57.350627 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:06:57.354693 8038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.351307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58062 (local address 127.22.49.254:35753)
0811 05:06:57.351433 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:57.351437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:57.351604 (+ 167us) server_negotiation.cc:407] Connection header received
0811 05:06:57.351752 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:57.351754 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:57.351852 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:57.351954 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:06:57.352189 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.352729 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.353622 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.353836 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.353925 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.354209 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:06:57.354384 (+ 175us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 05:06:57.354595 (+ 211us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58062: token expired
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 05:06:57.354791 8038 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58062: token expired
W20260811 05:06:57.355140 7747 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.22.49.254:35753)
I20260811 05:06:57.361801 8038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.355524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58066 (local address 127.22.49.254:35753)
0811 05:06:57.355656 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:57.355658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:57.355670 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:06:57.355702 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:57.355704 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:57.355737 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:57.355795 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:06:57.356409 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.356851 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.357565 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.357754 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.357824 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.359192 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:06:57.359194 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:06:57.359196 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:06:57.359214 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:06:57.360518 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:57.360886 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:57.360888 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:57.360890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:57.360966 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:06:57.361187 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:06:57.361189 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:06:57.361190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:06:57.361340 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:06:57.361440 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:57.361606 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 05:06:57.361690 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 05:06:57.364213 7831 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58066:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:06:57.367489 7831 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:06:57.375078 7962 tablet_service.cc:1467] Processing CreateTablet for tablet 04b76c97e79f47cfa3ca81210d059bbb (DEFAULT_TABLE table=test-table [id=c4f71dcdf8384b649bd906e3d78eda6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:06:57.375756 7962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04b76c97e79f47cfa3ca81210d059bbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:57.378638 7917 tablet_bootstrap.cc:492] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7: Bootstrap starting.
I20260811 05:06:57.378844 8044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.373935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38389 (local address 127.0.0.1:37202)
0811 05:06:57.374071 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:57.374088 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:57.374166 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:57.375274 (+ 1108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:57.375280 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:57.375299 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:57.375407 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:57.375425 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.376485 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.376491 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:57.377565 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:57.377574 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.378394 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.378397 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:57.378500 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.378542 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 05:06:57.378640 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 05:06:57.378719 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 05:06:57.378899 8338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.374280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37202 (local address 127.22.49.194:38389)
0811 05:06:57.374743 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:57.374763 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:57.374794 (+ 31us) server_negotiation.cc:407] Connection header received
0811 05:06:57.374878 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:57.374884 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:57.375124 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:57.375338 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:57.375524 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.376370 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.377688 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.378263 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.378383 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.378563 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:57.378669 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 05:06:57.378757 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":129,"threads_started":1}
I20260811 05:06:57.379565 7917 tablet_bootstrap.cc:654] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:57.379798 8337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.374194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:40453 (local address 127.0.0.1:51798)
0811 05:06:57.374470 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:57.374484 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:57.374567 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:57.375515 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:57.375518 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:57.375537 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:57.375625 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:57.375630 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.377097 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.377101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:57.378224 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:57.378236 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.379413 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.379417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:57.379503 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.379526 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 05:06:57.379603 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 05:06:57.379664 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":120,"threads_started":1}
I20260811 05:06:57.380985 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.374648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51798 (local address 127.22.49.195:40453)
0811 05:06:57.375057 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:57.375070 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:57.375097 (+ 27us) server_negotiation.cc:407] Connection header received
0811 05:06:57.375172 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:57.375178 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:57.375355 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:57.375763 (+ 408us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:57.375940 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.376954 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.378389 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.379193 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.379303 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.379431 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:57.379659 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 05:06:57.380848 (+ 1189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":155,"threads_started":1}
I20260811 05:06:57.381364 7917 tablet_bootstrap.cc:492] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7: No bootstrap required, opened a new log
I20260811 05:06:57.381462 7917 ts_tablet_manager.cc:1397] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 05:06:57.381922 7917 raft_consensus.cc:348] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:06:57.382067 7917 raft_consensus.cc:374] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:57.382107 7917 raft_consensus.cc:729] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d22b1610e024f3abcb45f0312963ac7, State: Initialized, Role: FOLLOWER
I20260811 05:06:57.382236 7917 consensus_queue.cc:260] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:06:57.382586 7917 ts_tablet_manager.cc:1428] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 05:06:57.382184 8113 tablet_service.cc:1467] Processing CreateTablet for tablet 04b76c97e79f47cfa3ca81210d059bbb (DEFAULT_TABLE table=test-table [id=c4f71dcdf8384b649bd906e3d78eda6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:06:57.383370 8113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04b76c97e79f47cfa3ca81210d059bbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:57.383797 8255 tablet_service.cc:1467] Processing CreateTablet for tablet 04b76c97e79f47cfa3ca81210d059bbb (DEFAULT_TABLE table=test-table [id=c4f71dcdf8384b649bd906e3d78eda6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:06:57.384805 8255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04b76c97e79f47cfa3ca81210d059bbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:06:57.390571 8341 tablet_bootstrap.cc:492] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1: Bootstrap starting.
I20260811 05:06:57.391222 8342 tablet_bootstrap.cc:492] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9: Bootstrap starting.
I20260811 05:06:57.393260 8342 tablet_bootstrap.cc:654] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:57.393364 8341 tablet_bootstrap.cc:654] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1: Neither blocks nor log segments found. Creating new log.
I20260811 05:06:57.394297 8341 log.cc:824] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:57.394501 8342 log.cc:824] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9: Log is configured to *not* fsync() on all Append() calls
I20260811 05:06:57.396126 8341 tablet_bootstrap.cc:492] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1: No bootstrap required, opened a new log
I20260811 05:06:57.396234 8342 tablet_bootstrap.cc:492] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9: No bootstrap required, opened a new log
I20260811 05:06:57.396334 8341 ts_tablet_manager.cc:1397] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 05:06:57.396456 8342 ts_tablet_manager.cc:1397] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 05:06:57.399858 8342 raft_consensus.cc:348] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:06:57.400122 8342 raft_consensus.cc:374] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:57.400182 8342 raft_consensus.cc:729] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4078da34cd9943a48816009d38f299b9, State: Initialized, Role: FOLLOWER
I20260811 05:06:57.400046 8341 raft_consensus.cc:348] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:06:57.400331 8341 raft_consensus.cc:374] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:06:57.400408 8341 raft_consensus.cc:729] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257bcb3589484ef2b7b7cba8be9789d1, State: Initialized, Role: FOLLOWER
I20260811 05:06:57.400619 8342 consensus_queue.cc:260] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:06:57.400828 8341 consensus_queue.cc:260] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:06:57.401254 8327 heartbeater.cc:503] Master 127.22.49.254:35753 was elected leader, sending a full tablet report...
I20260811 05:06:57.401471 8186 heartbeater.cc:503] Master 127.22.49.254:35753 was elected leader, sending a full tablet report...
I20260811 05:06:57.401559 8342 ts_tablet_manager.cc:1428] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 05:06:57.401736 8341 ts_tablet_manager.cc:1428] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260811 05:06:57.411093 8037 tablet.cc:2369] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:06:57.520102 8043 raft_consensus.cc:482] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:06:57.520455 8043 raft_consensus.cc:504] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:06:57.521737 8043 leader_election.cc:288] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389), 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453)
I20260811 05:06:57.525892 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.522090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:54321 (local address 127.22.49.195:40453)
0811 05:06:57.522227 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:57.522232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:57.522493 (+ 261us) server_negotiation.cc:407] Connection header received
0811 05:06:57.522695 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:57.522698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:57.522751 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:57.522841 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:57.523127 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.523655 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.524821 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.525293 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.525429 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.525490 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:57.525692 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 05:06:57.525768 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 05:06:57.526288 8338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.522102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:50241 (local address 127.22.49.194:38389)
0811 05:06:57.522227 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:57.522232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:57.522627 (+ 395us) server_negotiation.cc:407] Connection header received
0811 05:06:57.522780 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:57.522783 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:57.522838 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:57.522945 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:06:57.523231 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.523706 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.524817 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.525308 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.525436 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.525490 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:57.526098 (+ 608us) server_negotiation.cc:299] Negotiation successful
0811 05:06:57.526171 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 05:06:57.525940 8347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.521981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38389 (local address 127.22.49.193:50241)
0811 05:06:57.522510 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:57.522522 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:57.522657 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:57.522957 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:57.522960 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:57.523002 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:57.523095 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:57.523101 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.523814 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.523819 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:57.524687 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:57.524697 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.525542 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.525546 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:57.525630 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.525657 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 05:06:57.525716 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 05:06:57.525765 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":59,"thread_start_us":92,"threads_started":1}
I20260811 05:06:57.525974 8348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.521981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:40453 (local address 127.22.49.193:54321)
0811 05:06:57.522376 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:57.522389 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:06:57.522549 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:06:57.522854 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:06:57.522857 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:06:57.522875 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:06:57.523010 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:57.523017 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.523776 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.523781 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:57.524691 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:06:57.524700 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.525432 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.525436 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:06:57.525525 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.525576 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 05:06:57.525655 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 05:06:57.525744 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":38,"thread_start_us":118,"threads_started":1}
I20260811 05:06:57.527163 8280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b76c97e79f47cfa3ca81210d059bbb" candidate_uuid: "2d22b1610e024f3abcb45f0312963ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4078da34cd9943a48816009d38f299b9" is_pre_election: true
I20260811 05:06:57.527138 8136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b76c97e79f47cfa3ca81210d059bbb" candidate_uuid: "2d22b1610e024f3abcb45f0312963ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257bcb3589484ef2b7b7cba8be9789d1" is_pre_election: true
I20260811 05:06:57.527477 8136 raft_consensus.cc:2454] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d22b1610e024f3abcb45f0312963ac7 in term 0.
I20260811 05:06:57.527477 8280 raft_consensus.cc:2454] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d22b1610e024f3abcb45f0312963ac7 in term 0.
I20260811 05:06:57.528025 7914 leader_election.cc:302] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 257bcb3589484ef2b7b7cba8be9789d1, 2d22b1610e024f3abcb45f0312963ac7, 4078da34cd9943a48816009d38f299b9; no voters:
I20260811 05:06:57.528322 8043 raft_consensus.cc:2781] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:06:57.528439 8043 raft_consensus.cc:482] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:06:57.528499 8043 raft_consensus.cc:3037] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:57.529528 8043 raft_consensus.cc:504] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:06:57.529870 8043 leader_election.cc:288] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389), 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453)
I20260811 05:06:57.530254 8280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b76c97e79f47cfa3ca81210d059bbb" candidate_uuid: "2d22b1610e024f3abcb45f0312963ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4078da34cd9943a48816009d38f299b9"
I20260811 05:06:57.530368 8280 raft_consensus.cc:3037] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:57.531136 8136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04b76c97e79f47cfa3ca81210d059bbb" candidate_uuid: "2d22b1610e024f3abcb45f0312963ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257bcb3589484ef2b7b7cba8be9789d1"
I20260811 05:06:57.531281 8136 raft_consensus.cc:3037] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:06:57.531592 8280 raft_consensus.cc:2454] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d22b1610e024f3abcb45f0312963ac7 in term 1.
I20260811 05:06:57.531929 7914 leader_election.cc:302] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d22b1610e024f3abcb45f0312963ac7, 4078da34cd9943a48816009d38f299b9; no voters:
I20260811 05:06:57.532120 8043 raft_consensus.cc:2781] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:06:57.532320 8043 raft_consensus.cc:686] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 LEADER]: Becoming Leader. State: Replica: 2d22b1610e024f3abcb45f0312963ac7, State: Running, Role: LEADER
I20260811 05:06:57.532610 8043 consensus_queue.cc:237] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:06:57.532737 8136 raft_consensus.cc:2454] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d22b1610e024f3abcb45f0312963ac7 in term 1.
I20260811 05:06:57.535652 7831 catalog_manager.cc:5495] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d22b1610e024f3abcb45f0312963ac7 (127.22.49.193). New cstate: current_term: 1 leader_uuid: "2d22b1610e024f3abcb45f0312963ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260811 05:06:57.571575 8352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.567784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34170 (local address 127.22.49.193:36669)
0811 05:06:57.568092 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0811 05:06:57.568100 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:06:57.568111 (+ 11us) server_negotiation.cc:407] Connection header received
0811 05:06:57.568184 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:06:57.568187 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:06:57.568241 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:06:57.568409 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:06:57.568686 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.569215 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.570044 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:06:57.570275 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:06:57.570386 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:06:57.570666 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:06:57.571148 (+ 482us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:06:57.571279 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 05:06:57.571353 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 05:06:57.571410 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":88,"threads_started":1}
W20260811 05:06:57.573599 8328 tablet.cc:2369] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:06:57.575563 8280 raft_consensus.cc:1261] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9 [term 1 FOLLOWER]: Refusing update from remote peer 2d22b1610e024f3abcb45f0312963ac7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:06:57.575632 8136 raft_consensus.cc:1261] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1 [term 1 FOLLOWER]: Refusing update from remote peer 2d22b1610e024f3abcb45f0312963ac7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:06:57.576323 8349 consensus_queue.cc:1035] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:06:57.576519 8043 consensus_queue.cc:1035] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:06:57.584389 8354 mvcc.cc:205] Tried to move back new op lower bound from 7317196052783202304 to 7317196052616617984. Current Snapshot: MvccSnapshot[applied={T|T < 7317196052783202304}]
I20260811 05:06:57.584980 8355 mvcc.cc:205] Tried to move back new op lower bound from 7317196052783202304 to 7317196052616617984. Current Snapshot: MvccSnapshot[applied={T|T < 7317196052783202304}]
I20260811 05:06:57.592011 7831 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:06:57.592176 7831 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:06:57.594594 7831 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Sending DeleteTablet for 3 replicas of tablet 04b76c97e79f47cfa3ca81210d059bbb
I20260811 05:06:57.595374 7962 tablet_service.cc:1514] Processing DeleteTablet for tablet 04b76c97e79f47cfa3ca81210d059bbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:57 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:34158
I20260811 05:06:57.595330 8255 tablet_service.cc:1514] Processing DeleteTablet for tablet 04b76c97e79f47cfa3ca81210d059bbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:57 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:51798
I20260811 05:06:57.595364 8113 tablet_service.cc:1514] Processing DeleteTablet for tablet 04b76c97e79f47cfa3ca81210d059bbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:06:57 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:37202
I20260811 05:06:57.595562 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 7872
I20260811 05:06:57.599437 8365 tablet_replica.cc:330] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9: stopping tablet replica
I20260811 05:06:57.599808 8365 raft_consensus.cc:2229] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:06:57.600168 8365 raft_consensus.cc:2258] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:06:57.600585 8364 tablet_replica.cc:330] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1: stopping tablet replica
I20260811 05:06:57.600889 8364 raft_consensus.cc:2229] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:06:57.601172 8364 raft_consensus.cc:2258] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:06:57.601913 8365 ts_tablet_manager.cc:1905] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:06:57.602579 8364 ts_tablet_manager.cc:1905] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:06:57.604969 8365 ts_tablet_manager.cc:1918] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:06:57.605093 8365 log.cc:1196] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/04b76c97e79f47cfa3ca81210d059bbb
I20260811 05:06:57.605381 8364 ts_tablet_manager.cc:1918] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:06:57.605482 8365 ts_tablet_manager.cc:1939] T 04b76c97e79f47cfa3ca81210d059bbb P 4078da34cd9943a48816009d38f299b9: Deleting consensus metadata
I20260811 05:06:57.605486 8364 log.cc:1196] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/04b76c97e79f47cfa3ca81210d059bbb
I20260811 05:06:57.605813 8364 ts_tablet_manager.cc:1939] T 04b76c97e79f47cfa3ca81210d059bbb P 257bcb3589484ef2b7b7cba8be9789d1: Deleting consensus metadata
I20260811 05:06:57.606851 7815 catalog_manager.cc:4841] TS 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389): tablet 04b76c97e79f47cfa3ca81210d059bbb (table test-table [id=c4f71dcdf8384b649bd906e3d78eda6e]) successfully deleted
W20260811 05:06:57.606886 7814 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:36669 (error 108)
I20260811 05:06:57.607079 7816 catalog_manager.cc:4841] TS 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453): tablet 04b76c97e79f47cfa3ca81210d059bbb (table test-table [id=c4f71dcdf8384b649bd906e3d78eda6e]) successfully deleted
I20260811 05:06:57.607743 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 8042
I20260811 05:06:57.608148 8337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:06:57.607762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:36669 (local address 127.0.0.1:34186)
0811 05:06:57.607959 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 05:06:57.608046 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:36669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260811 05:06:57.609460 7814 catalog_manager.cc:4584] TS 2d22b1610e024f3abcb45f0312963ac7 (127.22.49.193:36669): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 04b76c97e79f47cfa3ca81210d059bbb: Network error: Client connection negotiation failed: client connection to 127.22.49.193:36669: connect: Connection refused (error 111)
I20260811 05:06:57.616362 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 8189
I20260811 05:06:57.626178 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 7793
I20260811 05:07:17.635268 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:35753
--webserver_interface=127.22.49.254
--webserver_port=41509
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:35753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:17.750634 8367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:17.750903 8367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:17.750945 8367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:17.755141 8367 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 05:07:17.755198 8367 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 05:07:17.755214 8367 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 05:07:17.755228 8367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:17.755247 8367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:17.755297 8367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:17.755331 8367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:17.755352 8367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:17.760702 8367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:35753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:35753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=41509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:17.761833 8367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:17.763003 8367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:17.772679 8372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:17.772691 8374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:17.772691 8376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:17.772749 8367 server_base.cc:1034] running on GCE node
I20260811 05:07:17.773634 8367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:17.774796 8367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:17.775996 8367 hybrid_clock.cc:648] HybridClock initialized: now 1786424837775978 us; error 37 us; skew 500 ppm
Aug 11 05:07:17 dist-test-slave-w206 krb5kdc[7193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424837, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:17.782925 8367 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:07:17.783962 8367 webserver.cc:460] Webserver started at http://127.22.49.254:41509/ using document root <none> and password file <none>
I20260811 05:07:17.784511 8367 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:17.784575 8367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:17.788439 8367 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:07:17.790601 8383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:17.791880 8367 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:07:17.792028 8367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "dd811024b65f4ed7b535aaab06bb0b83"
format_stamp: "Formatted at 2026-08-11 05:06:35 on dist-test-slave-w206"
server_key: "f19f4bbf30264aecc7a732684838545a"
server_key_iv: "5b6e38d35b5bffc6e66293329dbe4a28"
server_key_version: "encryptionkey@0"
I20260811 05:07:17.792603 8367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:17.808728 8367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:17.812801 8367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:17.813054 8367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:17.821512 8367 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:35753
I20260811 05:07:17.821825 8442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:35753 every 8 connection(s)
I20260811 05:07:17.822741 8367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:17.823742 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 8367
I20260811 05:07:17.824286 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:36669
--local_ip_for_outbound_sockets=127.22.49.193
--tserver_master_addrs=127.22.49.254:35753
--webserver_port=37555
--webserver_interface=127.22.49.193
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:07:17.828683 8443 sys_catalog.cc:263] Verifying existing consensus state
I20260811 05:07:17.830579 8443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Bootstrap starting.
I20260811 05:07:17.849628 8443 log.cc:824] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:17.861140 8443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:07:17.861778 8443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Bootstrap complete.
I20260811 05:07:17.866011 8443 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } }
I20260811 05:07:17.866415 8443 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd811024b65f4ed7b535aaab06bb0b83, State: Initialized, Role: FOLLOWER
I20260811 05:07:17.866899 8443 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } }
I20260811 05:07:17.867234 8443 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:17.867376 8443 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:17.867487 8443 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 2 FOLLOWER]: Advancing to term 3
I20260811 05:07:17.871744 8443 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } }
I20260811 05:07:17.872103 8443 leader_election.cc:302] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd811024b65f4ed7b535aaab06bb0b83; no voters:
I20260811 05:07:17.872462 8443 leader_election.cc:288] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 05:07:17.872609 8447 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 05:07:17.872825 8447 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [term 3 LEADER]: Becoming Leader. State: Replica: dd811024b65f4ed7b535aaab06bb0b83, State: Running, Role: LEADER
I20260811 05:07:17.873188 8447 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } }
I20260811 05:07:17.873777 8443 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:17.874589 8448 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "dd811024b65f4ed7b535aaab06bb0b83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } } }
I20260811 05:07:17.874718 8448 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:17.875408 8457 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:17.875492 8450 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd811024b65f4ed7b535aaab06bb0b83. Latest consensus state: current_term: 3 leader_uuid: "dd811024b65f4ed7b535aaab06bb0b83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd811024b65f4ed7b535aaab06bb0b83" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35753 } } }
I20260811 05:07:17.875744 8450 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:17.880483 8457 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:17.881206 8457 catalog_manager.cc:1259] Loaded cluster ID: e36604a7abba423fa43c5bcd61a970ff
I20260811 05:07:17.881306 8457 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:17.883818 8457 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:17.884529 8457 catalog_manager.cc:5879] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Loaded TSK: 0
I20260811 05:07:17.884624 8457 catalog_manager.cc:5879] T 00000000000000000000000000000000 P dd811024b65f4ed7b535aaab06bb0b83: Loaded TSK: 1
F20260811 05:07:17.885356 8457 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2b815bf9ad google::LogMessage::Fail() at ??:0
@ 0x7f2b815c288a google::LogMessage::SendToLog() at ??:0
@ 0x7f2b815bf4de google::LogMessage::Flush() at ??:0
@ 0x7f2b815c0a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2b8428318d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f2b8427bf0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f2b8bf247bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f2b8befe99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f2b8beff178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f2b8bf40df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f2b8bf5f82b std::function<>::operator()() at ??:0
@ 0x7f2b8befeb4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f2b8befff3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f2b8befc579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f2b8bf40640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f2b838113d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2b83811c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f2b838133f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f2b83802512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2b84e466db start_thread at ??:0
@ 0x7f2b800bd61f clone at ??:0
W20260811 05:07:17.981683 8445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:17.981981 8445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:17.982070 8445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:17.986204 8445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:17.986287 8445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:17.986390 8445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:07:17.991843 8445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:36669
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=37555
--tserver_master_addrs=127.22.49.254:35753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:17.992950 8445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:17.993979 8445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:18.005119 8494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:18.005128 8497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:18.005432 8493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:18.005610 8445 server_base.cc:1034] running on GCE node
I20260811 05:07:18.006011 8445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:18.006669 8445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:18.007854 8445 hybrid_clock.cc:648] HybridClock initialized: now 1786424838007814 us; error 54 us; skew 500 ppm
Aug 11 05:07:18 dist-test-slave-w206 krb5kdc[7193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424838, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:18.011375 8445 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:07:18.012362 8445 webserver.cc:460] Webserver started at http://127.22.49.193:37555/ using document root <none> and password file <none>
I20260811 05:07:18.012964 8445 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:18.013026 8445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:18.017000 8445 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:07:18.019241 8504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:18.020629 8445 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:07:18.020819 8445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "2d22b1610e024f3abcb45f0312963ac7"
format_stamp: "Formatted at 2026-08-11 05:06:35 on dist-test-slave-w206"
server_key: "a43eac48e9b0c0bc58f6aa727fdb36cb"
server_key_iv: "124b7e9c439282ebe4559daaeed8e8ed"
server_key_version: "encryptionkey@0"
I20260811 05:07:18.021377 8445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:18.037756 8445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:18.041147 8445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:18.041359 8445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:18.041949 8445 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:18.043162 8511 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 05:07:18.048605 8445 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 05:07:18.048707 8445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.001s
I20260811 05:07:18.048789 8445 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 05:07:18.050474 8445 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 05:07:18.050545 8445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 05:07:18.050841 8511 tablet_bootstrap.cc:492] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7: Bootstrap starting.
I20260811 05:07:18.061517 8445 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:36669
I20260811 05:07:18.061776 8629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:36669 every 8 connection(s)
I20260811 05:07:18.062585 8445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:07:18.063102 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 8445
I20260811 05:07:18.063669 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:38389
--local_ip_for_outbound_sockets=127.22.49.194
--tserver_master_addrs=127.22.49.254:35753
--webserver_port=36559
--webserver_interface=127.22.49.194
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:07:18.073117 8511 log.cc:824] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:18.080418 8511 tablet_bootstrap.cc:492] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 05:07:18.080821 8511 tablet_bootstrap.cc:492] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7: Bootstrap complete.
I20260811 05:07:18.082082 8511 ts_tablet_manager.cc:1397] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7: Time spent bootstrapping tablet: real 0.031s user 0.019s sys 0.008s
I20260811 05:07:18.084493 8511 raft_consensus.cc:348] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:07:18.085031 8511 raft_consensus.cc:729] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d22b1610e024f3abcb45f0312963ac7, State: Initialized, Role: FOLLOWER
I20260811 05:07:18.085655 8511 consensus_queue.cc:260] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:07:18.086752 8511 ts_tablet_manager.cc:1428] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
W20260811 05:07:18.151732 8634 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:07:18.065580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:36295)
0811 05:07:18.066106 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:18.066161 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:18.067230 (+ 1069us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:18.150717 (+ 83487us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":159,"threads_started":1}
W20260811 05:07:18.152415 8631 heartbeater.cc:644] Failed to heartbeat to 127.22.49.254:35753 (0 consecutive failures): Network error: Failed to ping master at 127.22.49.254:35753: Client connection negotiation failed: client connection to 127.22.49.254:35753: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 05:07:18.153264 8634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:18.152953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:53419)
0811 05:07:18.153101 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:18.153186 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 05:07:18.154052 8634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:18.153808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:59165)
0811 05:07:18.153930 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:18.153993 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 05:07:18.154317 8631 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 05:07:18.205704 8633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:18.205998 8633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:18.206082 8633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:18.210130 8633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:18.210227 8633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:18.210319 8633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:07:18.215855 8633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:38389
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=36559
--tserver_master_addrs=127.22.49.254:35753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:18.216922 8633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:18.217948 8633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:18.227761 8641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:18.227831 8633 server_base.cc:1034] running on GCE node
W20260811 05:07:18.227788 8642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:18.227753 8644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:18.228413 8633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:18.229049 8633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:18.230221 8633 hybrid_clock.cc:648] HybridClock initialized: now 1786424838230190 us; error 41 us; skew 500 ppm
Aug 11 05:07:18 dist-test-slave-w206 krb5kdc[7193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424838, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:18.233377 8633 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:07:18.234225 8633 webserver.cc:460] Webserver started at http://127.22.49.194:36559/ using document root <none> and password file <none>
I20260811 05:07:18.234745 8633 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:18.234803 8633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:18.239809 8633 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 05:07:18.242439 8652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:18.243909 8633 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:18.244055 8633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "257bcb3589484ef2b7b7cba8be9789d1"
format_stamp: "Formatted at 2026-08-11 05:06:36 on dist-test-slave-w206"
server_key: "98d0a00b1f8c462d45ca53d7113bc0a0"
server_key_iv: "45dc1459a07b2781a1c586a15063f20e"
server_key_version: "encryptionkey@0"
I20260811 05:07:18.244643 8633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:18.254144 8633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:18.257426 8633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:18.257630 8633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:18.258231 8633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:18.259122 8633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:18.259189 8633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:18.259256 8633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:18.259306 8633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:18.268646 8633 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:38389
I20260811 05:07:18.268671 8777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:38389 every 8 connection(s)
I20260811 05:07:18.269662 8633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:07:18.273437 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 8633
I20260811 05:07:18.273738 8781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:18.271815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:48751)
0811 05:07:18.272715 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:18.272826 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":708,"thread_start_us":554,"threads_started":1}
I20260811 05:07:18.274019 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:40453
--local_ip_for_outbound_sockets=127.22.49.195
--tserver_master_addrs=127.22.49.254:35753
--webserver_port=44973
--webserver_interface=127.22.49.195
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:18.274214 8779 heartbeater.cc:644] Failed to heartbeat to 127.22.49.254:35753 (0 consecutive failures): Network error: Failed to ping master at 127.22.49.254:35753: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
I20260811 05:07:18.274962 8781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:18.274647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:60253)
0811 05:07:18.274802 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:18.274879 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 05:07:18.275714 8781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:18.275439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:55869)
0811 05:07:18.275574 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:18.275635 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 05:07:18.275916 8779 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 05:07:18.387524 8782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:18.387790 8782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:18.387836 8782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:18.391889 8782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:18.391949 8782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:18.392048 8782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:07:18.397238 8782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:40453
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=44973
--tserver_master_addrs=127.22.49.254:35753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:18.398332 8782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:18.399410 8782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:07:18.409180 8782 server_base.cc:1034] running on GCE node
W20260811 05:07:18.409111 8788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:18.409073 8789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:18.409096 8791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:18.409747 8782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:18.410385 8782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:18.411600 8782 hybrid_clock.cc:648] HybridClock initialized: now 1786424838411592 us; error 29 us; skew 500 ppm
Aug 11 05:07:18 dist-test-slave-w206 krb5kdc[7193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424838, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:18.414443 8782 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:07:18.415438 8782 webserver.cc:460] Webserver started at http://127.22.49.195:44973/ using document root <none> and password file <none>
I20260811 05:07:18.416008 8782 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:18.416105 8782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:18.419862 8782 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 05:07:18.422149 8798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:18.423470 8782 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:18.423601 8782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "4078da34cd9943a48816009d38f299b9"
format_stamp: "Formatted at 2026-08-11 05:06:36 on dist-test-slave-w206"
server_key: "ae910609bfe6da3459c3cd49ac84c9dc"
server_key_iv: "9cc962b436411b759197675f45cb777e"
server_key_version: "encryptionkey@0"
I20260811 05:07:18.424144 8782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:18.450079 8782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:18.453476 8782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:18.453691 8782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:18.454314 8782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:18.455248 8782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:18.455320 8782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:18.455394 8782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:18.455446 8782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:18.464747 8782 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:40453
I20260811 05:07:18.464779 8919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:40453 every 8 connection(s)
I20260811 05:07:18.465763 8782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:07:18.469558 8922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:18.467858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:33171)
0811 05:07:18.468315 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:18.468431 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":120,"threads_started":1}
W20260811 05:07:18.470002 8920 heartbeater.cc:644] Failed to heartbeat to 127.22.49.254:35753 (0 consecutive failures): Network error: Failed to ping master at 127.22.49.254:35753: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
I20260811 05:07:18.470613 8922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:18.470383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:60909)
0811 05:07:18.470501 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:18.470559 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 05:07:18.471297 8922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:18.471098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:51781)
0811 05:07:18.471194 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:18.471240 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 05:07:18.471486 8920 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 05:07:18.472165 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 8782
I20260811 05:07:19.155637 8924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:19.155143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:56717)
0811 05:07:19.155447 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:19.155514 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":83,"threads_started":1}
I20260811 05:07:19.277169 8925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:19.276679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:32819)
0811 05:07:19.276969 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:19.277041 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":75,"threads_started":1}
I20260811 05:07:19.472630 8926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:19.472160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:34723)
0811 05:07:19.472460 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:19.472522 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":98,"threads_started":1}
I20260811 05:07:19.564136 8927 raft_consensus.cc:482] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:19.564364 8927 raft_consensus.cc:504] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:07:19.565485 8927 leader_election.cc:288] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389), 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453)
Aug 11 05:07:19 dist-test-slave-w206 krb5kdc[7193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424838, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.194@KRBTEST.COM
Aug 11 05:07:19 dist-test-slave-w206 krb5kdc[7193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424838, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.195@KRBTEST.COM
I20260811 05:07:19.583778 8924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:19.565751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:38389 (local address 127.22.49.193:45709)
0811 05:07:19.565913 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:19.565933 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:19.566051 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:19.568343 (+ 2292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:19.568349 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:19.569026 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:19.569863 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:19.569885 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:19.571831 (+ 1946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:19.571836 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:19.573550 (+ 1714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:19.573561 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:19.574561 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:19.574564 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:19.574850 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:19.575711 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:19.575751 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:19.577878 (+ 2127us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:19.580570 (+ 2692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:19.580575 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:19.580586 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:19.581072 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:19.581502 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:19.581506 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:19.581508 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:19.581728 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:19.582531 (+ 803us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:19.582538 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:19.582924 (+ 386us) client_negotiation.cc:769] Sending connection context
0811 05:07:19.583178 (+ 254us) client_negotiation.cc:240] Negotiation successful
0811 05:07:19.583608 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":592,"spinlock_wait_cycles":57088}
I20260811 05:07:19.583838 8930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:19.566048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:36535 (local address 127.22.49.195:40453)
0811 05:07:19.566553 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:19.566575 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:19.566606 (+ 31us) server_negotiation.cc:407] Connection header received
0811 05:07:19.567400 (+ 794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:19.567407 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:19.567831 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:19.568169 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:19.570059 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:19.571668 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:19.573687 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:19.574435 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:19.574593 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:19.578444 (+ 3851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:19.578451 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:19.578468 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:19.578506 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:19.580567 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:19.581196 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:19.581203 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:19.581209 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:19.581404 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:19.581836 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:19.581841 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:19.581843 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:19.582412 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:19.582517 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:19.583362 (+ 845us) server_negotiation.cc:299] Negotiation successful
0811 05:07:19.583633 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":141,"threads_started":1}
I20260811 05:07:19.583838 8929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:19.565930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:45709 (local address 127.22.49.194:38389)
0811 05:07:19.566320 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:19.566349 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:19.566396 (+ 47us) server_negotiation.cc:407] Connection header received
0811 05:07:19.567373 (+ 977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:19.567383 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:19.567832 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:19.568169 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:19.570059 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:19.571668 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:19.573687 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:19.574416 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:19.574593 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:19.578118 (+ 3525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:19.578123 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:19.578136 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:19.578164 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:19.580429 (+ 2265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:19.581196 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:19.581203 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:19.581209 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:19.581362 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:19.581856 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:19.581859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:19.581860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:19.582381 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:19.582517 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:19.583331 (+ 814us) server_negotiation.cc:299] Negotiation successful
0811 05:07:19.583633 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":86,"threads_started":1}
I20260811 05:07:19.583778 8928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:19.565756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:40453 (local address 127.22.49.193:36535)
0811 05:07:19.566244 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:19.566259 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:19.566358 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:19.568343 (+ 1985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:19.568349 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:19.569026 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:19.569863 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:19.569885 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:19.571841 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:19.571843 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:19.573550 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:19.573561 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:19.574561 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:19.574564 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:19.574847 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:19.575711 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:19.575738 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:19.578228 (+ 2490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:19.580672 (+ 2444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:19.580675 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:19.580676 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:19.581075 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:19.581502 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:19.581506 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:19.581508 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:19.581728 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:19.582531 (+ 803us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:19.582538 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:19.582924 (+ 386us) client_negotiation.cc:769] Sending connection context
0811 05:07:19.583178 (+ 254us) client_negotiation.cc:240] Negotiation successful
0811 05:07:19.583554 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425,"mutex_wait_us":641,"spinlock_wait_cycles":50304,"thread_start_us":73,"threads_started":1}
W20260811 05:07:19.586709 8507 leader_election.cc:341] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389): Not found: Tablet not found: 04b76c97e79f47cfa3ca81210d059bbb
W20260811 05:07:19.587244 8508 leader_election.cc:341] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453): Not found: Tablet not found: 04b76c97e79f47cfa3ca81210d059bbb
I20260811 05:07:19.587345 8508 leader_election.cc:302] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d22b1610e024f3abcb45f0312963ac7; no voters: 257bcb3589484ef2b7b7cba8be9789d1, 4078da34cd9943a48816009d38f299b9
I20260811 05:07:19.587682 8927 raft_consensus.cc:2726] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:07:20.157043 8931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:20.156585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:36403)
0811 05:07:20.156864 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:20.156927 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":80,"threads_started":1}
I20260811 05:07:20.278646 8932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:20.277962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:33411)
0811 05:07:20.278422 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:20.278496 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":118,"threads_started":1}
I20260811 05:07:20.473734 8933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:20.473363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:60447)
0811 05:07:20.473599 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:20.473649 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":72,"threads_started":1}
I20260811 05:07:21.118732 8934 raft_consensus.cc:482] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:21.118863 8934 raft_consensus.cc:504] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:07:21.119346 8934 leader_election.cc:288] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389), 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453)
W20260811 05:07:21.120196 8507 leader_election.cc:341] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389): Not found: Tablet not found: 04b76c97e79f47cfa3ca81210d059bbb
W20260811 05:07:21.120339 8508 leader_election.cc:341] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453): Not found: Tablet not found: 04b76c97e79f47cfa3ca81210d059bbb
I20260811 05:07:21.120445 8508 leader_election.cc:302] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d22b1610e024f3abcb45f0312963ac7; no voters: 257bcb3589484ef2b7b7cba8be9789d1, 4078da34cd9943a48816009d38f299b9
I20260811 05:07:21.120604 8934 raft_consensus.cc:2726] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:07:21.158499 8935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:21.157985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:56645)
0811 05:07:21.158318 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:21.158389 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":91,"threads_started":1}
I20260811 05:07:21.279924 8936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:21.279422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:56325)
0811 05:07:21.279723 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:21.279806 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":78,"threads_started":1}
I20260811 05:07:21.475065 8937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:21.474637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:52381)
0811 05:07:21.474896 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:21.474952 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":78,"threads_started":1}
I20260811 05:07:22.160168 8938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:22.159677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:49917)
0811 05:07:22.159949 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:22.160038 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":104,"threads_started":1}
I20260811 05:07:22.281352 8939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:22.280805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:60215)
0811 05:07:22.281144 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:22.281224 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":135,"threads_started":1}
I20260811 05:07:22.476267 8940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:22.475833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:57179)
0811 05:07:22.476105 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:22.476169 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":77,"threads_started":1}
I20260811 05:07:22.781908 8942 raft_consensus.cc:482] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:22.782060 8942 raft_consensus.cc:504] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:07:22.782522 8942 leader_election.cc:288] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389), 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453)
W20260811 05:07:22.783366 8508 leader_election.cc:341] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453): Not found: Tablet not found: 04b76c97e79f47cfa3ca81210d059bbb
W20260811 05:07:22.783471 8507 leader_election.cc:341] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389): Not found: Tablet not found: 04b76c97e79f47cfa3ca81210d059bbb
I20260811 05:07:22.783605 8507 leader_election.cc:302] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d22b1610e024f3abcb45f0312963ac7; no voters: 257bcb3589484ef2b7b7cba8be9789d1, 4078da34cd9943a48816009d38f299b9
I20260811 05:07:22.783759 8942 raft_consensus.cc:2726] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:07:23.161630 8944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:23.161143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:35283)
0811 05:07:23.161465 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:23.161529 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":81,"threads_started":1}
I20260811 05:07:23.282645 8946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:23.282202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:39223)
0811 05:07:23.282492 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:23.282552 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":103,"threads_started":1}
I20260811 05:07:23.477449 8947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:23.476984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:39203)
0811 05:07:23.477299 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:23.477356 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":95,"threads_started":1}
I20260811 05:07:24.163146 8948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:24.162543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:56495)
0811 05:07:24.162893 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:24.162962 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":81,"threads_started":1}
I20260811 05:07:24.283972 8949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:24.283495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:38507)
0811 05:07:24.283810 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:24.283875 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":105,"threads_started":1}
I20260811 05:07:24.478585 8950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:24.478216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:56665)
0811 05:07:24.478443 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:24.478495 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":72,"threads_started":1}
I20260811 05:07:25.164615 8951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:25.164107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:50385)
0811 05:07:25.164452 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:25.164516 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":86,"threads_started":1}
I20260811 05:07:25.285213 8952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:25.284739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:40631)
0811 05:07:25.285062 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:25.285120 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":99,"threads_started":1}
I20260811 05:07:25.479779 8953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:25.479356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:49229)
0811 05:07:25.479635 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:25.479686 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":71,"threads_started":1}
I20260811 05:07:26.166083 8954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:26.165614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:48987)
0811 05:07:26.165917 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:26.165984 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":80,"threads_started":1}
I20260811 05:07:26.286578 8956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:26.286093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:53459)
0811 05:07:26.286412 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:26.286480 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":80,"threads_started":1}
I20260811 05:07:26.480957 8957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:26.480552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:47739)
0811 05:07:26.480806 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:26.480862 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":87,"threads_started":1}
I20260811 05:07:27.167654 8958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:27.167176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:54707)
0811 05:07:27.167485 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:27.167545 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":95,"threads_started":1}
I20260811 05:07:27.287911 8959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:27.287447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:33557)
0811 05:07:27.287744 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:27.287812 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":97,"threads_started":1}
I20260811 05:07:27.482208 8960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:27.481767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:33537)
0811 05:07:27.482045 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:27.482108 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":86,"threads_started":1}
I20260811 05:07:27.604686 8961 raft_consensus.cc:482] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:27.604851 8961 raft_consensus.cc:504] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:07:27.605324 8961 leader_election.cc:288] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389), 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453)
W20260811 05:07:27.606384 8507 leader_election.cc:341] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389): Not found: Tablet not found: 04b76c97e79f47cfa3ca81210d059bbb
W20260811 05:07:27.606508 8508 leader_election.cc:341] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453): Not found: Tablet not found: 04b76c97e79f47cfa3ca81210d059bbb
I20260811 05:07:27.606611 8508 leader_election.cc:302] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d22b1610e024f3abcb45f0312963ac7; no voters: 257bcb3589484ef2b7b7cba8be9789d1, 4078da34cd9943a48816009d38f299b9
I20260811 05:07:27.606815 8961 raft_consensus.cc:2726] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:07:28.169080 8962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:28.168598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:47759)
0811 05:07:28.168914 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:28.168976 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":85,"threads_started":1}
I20260811 05:07:28.289428 8963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:28.288906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:44931)
0811 05:07:28.289226 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:28.289294 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":85,"threads_started":1}
I20260811 05:07:28.483657 8964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:28.483224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:45261)
0811 05:07:28.483503 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:28.483564 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":89,"threads_started":1}
I20260811 05:07:29.170533 8965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:29.170083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:49009)
0811 05:07:29.170359 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:29.170435 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":81,"threads_started":1}
I20260811 05:07:29.290809 8966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:29.290280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:55503)
0811 05:07:29.290648 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:29.290703 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":112,"threads_started":1}
I20260811 05:07:29.484975 8967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:29.484524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:35427)
0811 05:07:29.484800 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:29.484870 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":77,"threads_started":1}
I20260811 05:07:30.172047 8968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:30.171587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:59821)
0811 05:07:30.171882 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:30.171946 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":89,"threads_started":1}
I20260811 05:07:30.292081 8969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:30.291645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:54963)
0811 05:07:30.291914 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:30.291978 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":77,"threads_started":1}
I20260811 05:07:30.486214 8973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:30.485756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:51289)
0811 05:07:30.486040 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:30.486106 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":83,"threads_started":1}
I20260811 05:07:31.173487 8974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:31.172992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:50229)
0811 05:07:31.173301 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:31.173382 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":115,"threads_started":1}
I20260811 05:07:31.293660 8975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:31.293131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:55219)
0811 05:07:31.293464 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:31.293541 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":95,"threads_started":1}
I20260811 05:07:31.487640 8976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:31.487152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:60653)
0811 05:07:31.487476 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:31.487540 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":96,"threads_started":1}
I20260811 05:07:31.980661 8977 raft_consensus.cc:482] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:31.980847 8977 raft_consensus.cc:504] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257bcb3589484ef2b7b7cba8be9789d1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 38389 } } peers { permanent_uuid: "4078da34cd9943a48816009d38f299b9" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 40453 } } peers { permanent_uuid: "2d22b1610e024f3abcb45f0312963ac7" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 36669 } }
I20260811 05:07:31.981328 8977 leader_election.cc:288] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389), 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453)
W20260811 05:07:31.982242 8507 leader_election.cc:341] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 257bcb3589484ef2b7b7cba8be9789d1 (127.22.49.194:38389): Not found: Tablet not found: 04b76c97e79f47cfa3ca81210d059bbb
W20260811 05:07:31.982354 8508 leader_election.cc:341] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4078da34cd9943a48816009d38f299b9 (127.22.49.195:40453): Not found: Tablet not found: 04b76c97e79f47cfa3ca81210d059bbb
I20260811 05:07:31.982445 8508 leader_election.cc:302] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d22b1610e024f3abcb45f0312963ac7; no voters: 257bcb3589484ef2b7b7cba8be9789d1, 4078da34cd9943a48816009d38f299b9
I20260811 05:07:31.982580 8977 raft_consensus.cc:2726] T 04b76c97e79f47cfa3ca81210d059bbb P 2d22b1610e024f3abcb45f0312963ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 05:07:32.174888 8978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:32.174449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:44053)
0811 05:07:32.174731 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:32.174790 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":95,"threads_started":1}
I20260811 05:07:32.295185 8979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:32.294703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:49107)
0811 05:07:32.295025 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:32.295089 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":106,"threads_started":1}
I20260811 05:07:32.489034 8980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:32.488554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:33281)
0811 05:07:32.488863 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:32.488925 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":79,"threads_started":1}
I20260811 05:07:33.176535 8981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:33.176007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.193:42387)
0811 05:07:33.176353 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:33.176425 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":89,"threads_started":1}
I20260811 05:07:33.296661 8982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:33.296207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.194:55023)
0811 05:07:33.296493 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:33.296558 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":94,"threads_started":1}
I20260811 05:07:33.478672 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 8445
I20260811 05:07:33.486150 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 8633
I20260811 05:07:33.490712 8983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:33.490151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35753 (local address 127.22.49.195:47879)
0811 05:07:33.490467 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:33.490557 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.254:35753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":70,"threads_started":1}
I20260811 05:07:33.493919 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 8782
2026-08-11T05:07:33Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59491 ms)
[----------] 30 tests from SecurityITest (260738 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:33 dist-test-slave-w206 krb5kdc[8986](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:33 dist-test-slave-w206 krb5kdc[8986](info): set up 2 sockets
Aug 11 05:07:33 dist-test-slave-w206 krb5kdc[8986](info): commencing operation
krb5kdc: starting...
W20260811 05:07:34.597875 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:07:34 dist-test-slave-w206 krb5kdc[8986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:07:34.727873 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:39855
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:37741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:39855
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:34.843606 8999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:34.843887 8999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:34.843930 8999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:34.848235 8999 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:34.848343 8999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:34.848374 8999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:34.848392 8999 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:34.848412 8999 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:34.854240 8999 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:37741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:39855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:39855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8999
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:34.855521 8999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:34.856710 8999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:07:34.865788 8999 server_base.cc:1034] running on GCE node
W20260811 05:07:34.865739 9004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:34.865739 9005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:34.865768 9007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:34.866837 8999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:34.867964 8999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:34.869135 8999 hybrid_clock.cc:648] HybridClock initialized: now 1786424854869112 us; error 40 us; skew 500 ppm
Aug 11 05:07:34 dist-test-slave-w206 krb5kdc[8986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424854, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:34.877224 8999 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:07:34.878170 8999 webserver.cc:460] Webserver started at http://127.22.49.254:34795/ using document root <none> and password file <none>
I20260811 05:07:34.878767 8999 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:34.878877 8999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:34.879133 8999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:34.881237 8999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "113c62488bc0444082bd717964d0f1a6"
format_stamp: "Formatted at 2026-08-11 05:07:34 on dist-test-slave-w206"
server_key: "794a00d43ec8275934d9b061c487787a"
server_key_iv: "e13da2412abd96cc406c695c74537737"
server_key_version: "encryptionkey@0"
I20260811 05:07:34.881836 8999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "113c62488bc0444082bd717964d0f1a6"
format_stamp: "Formatted at 2026-08-11 05:07:34 on dist-test-slave-w206"
server_key: "794a00d43ec8275934d9b061c487787a"
server_key_iv: "e13da2412abd96cc406c695c74537737"
server_key_version: "encryptionkey@0"
I20260811 05:07:34.885612 8999 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 05:07:34.888533 9014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:34.889775 8999 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 05:07:34.889938 8999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "113c62488bc0444082bd717964d0f1a6"
format_stamp: "Formatted at 2026-08-11 05:07:34 on dist-test-slave-w206"
server_key: "794a00d43ec8275934d9b061c487787a"
server_key_iv: "e13da2412abd96cc406c695c74537737"
server_key_version: "encryptionkey@0"
I20260811 05:07:34.890053 8999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:34.917966 8999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:34.921269 8999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:34.921485 8999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:34.929593 8999 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:39855
I20260811 05:07:34.929626 9072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:39855 every 8 connection(s)
I20260811 05:07:34.930651 8999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:34.933832 9073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:34.935892 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 8999
I20260811 05:07:34.936046 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:07:34.936411 22727 external_mini_cluster.cc:1428] Setting key 53602afe14e20d731ef39a4beead5250
I20260811 05:07:34.941378 9073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6: Bootstrap starting.
I20260811 05:07:34.944108 9073 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:34.945106 9073 log.cc:824] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6: Log is configured to *not* fsync() on all Append() calls
Aug 11 05:07:34 dist-test-slave-w206 krb5kdc[8986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:07:34.947585 9073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6: No bootstrap required, opened a new log
I20260811 05:07:34.951797 9073 raft_consensus.cc:348] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "113c62488bc0444082bd717964d0f1a6" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39855 } }
I20260811 05:07:34.952025 9073 raft_consensus.cc:374] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:34.952126 9073 raft_consensus.cc:729] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113c62488bc0444082bd717964d0f1a6, State: Initialized, Role: FOLLOWER
I20260811 05:07:34.952597 9073 consensus_queue.cc:260] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "113c62488bc0444082bd717964d0f1a6" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39855 } }
I20260811 05:07:34.952736 9073 raft_consensus.cc:388] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:34.952775 9076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:34.937951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59818 (local address 127.22.49.254:39855)
0811 05:07:34.938414 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:34.938434 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:34.938478 (+ 44us) server_negotiation.cc:407] Connection header received
0811 05:07:34.939395 (+ 917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:34.939419 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:34.939847 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:34.940233 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:34.940962 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:34.942412 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:34.943392 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:34.944103 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:34.944322 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:34.947661 (+ 3339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:34.947671 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:34.947688 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:34.947724 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:34.949503 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:34.950053 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:34.950058 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:34.950063 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:34.950179 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:34.950470 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:34.950473 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:34.950474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:34.950898 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:34.951131 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:34.951428 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 05:07:34.951758 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":128,"threads_started":1}
I20260811 05:07:34.952827 9073 raft_consensus.cc:482] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:34.952975 9073 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:34.953926 9073 raft_consensus.cc:504] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "113c62488bc0444082bd717964d0f1a6" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39855 } }
I20260811 05:07:34.954272 9073 leader_election.cc:302] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 113c62488bc0444082bd717964d0f1a6; no voters:
I20260811 05:07:34.954617 9073 leader_election.cc:288] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:34.954706 9078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:34.954926 9078 raft_consensus.cc:686] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [term 1 LEADER]: Becoming Leader. State: Replica: 113c62488bc0444082bd717964d0f1a6, State: Running, Role: LEADER
I20260811 05:07:34.955324 9078 consensus_queue.cc:237] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "113c62488bc0444082bd717964d0f1a6" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39855 } }
I20260811 05:07:34.955966 9073 sys_catalog.cc:564] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:34.956547 9078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 113c62488bc0444082bd717964d0f1a6. Latest consensus state: current_term: 1 leader_uuid: "113c62488bc0444082bd717964d0f1a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "113c62488bc0444082bd717964d0f1a6" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39855 } } }
I20260811 05:07:34.956768 9078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:34.956990 9080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "113c62488bc0444082bd717964d0f1a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "113c62488bc0444082bd717964d0f1a6" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39855 } } }
I20260811 05:07:34.957144 9080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:34.957307 9085 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:34.960580 9085 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:34.966791 9085 catalog_manager.cc:1347] Generated new cluster ID: 41397497f1374c2f809aa1e3f666baca
I20260811 05:07:34.966866 9085 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:34.992960 9085 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:34.994344 9085 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:35.001082 9085 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6: Generated new TSK 0
I20260811 05:07:35.001972 9085 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:07:35.047582 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:39855
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:37741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:35.185329 9101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:35.185676 9101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:35.185803 9101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:35.190066 9101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:35.190182 9101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:35.190290 9101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:07:35.196309 9101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:37741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:39855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:35.197465 9101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:35.198530 9101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:07:35.208807 9101 server_base.cc:1034] running on GCE node
W20260811 05:07:35.208762 9107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:35.208757 9108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:35.208737 9110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:35.209522 9101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:35.210165 9101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:35.211362 9101 hybrid_clock.cc:648] HybridClock initialized: now 1786424855211338 us; error 32 us; skew 500 ppm
Aug 11 05:07:35 dist-test-slave-w206 krb5kdc[8986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424855, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:35.214326 9101 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:07:35.215335 9101 webserver.cc:460] Webserver started at http://127.22.49.193:38391/ using document root <none> and password file <none>
I20260811 05:07:35.215910 9101 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:35.216002 9101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:35.216233 9101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:35.218294 9101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "2161bf98f722458ab5c0320e820cd9f8"
format_stamp: "Formatted at 2026-08-11 05:07:35 on dist-test-slave-w206"
server_key: "08bdf1d82c1592dd743c1dd7fce7978b"
server_key_iv: "c9e70b37642de397982b2b156678664c"
server_key_version: "encryptionkey@0"
I20260811 05:07:35.218860 9101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "2161bf98f722458ab5c0320e820cd9f8"
format_stamp: "Formatted at 2026-08-11 05:07:35 on dist-test-slave-w206"
server_key: "08bdf1d82c1592dd743c1dd7fce7978b"
server_key_iv: "c9e70b37642de397982b2b156678664c"
server_key_version: "encryptionkey@0"
I20260811 05:07:35.222821 9101 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 05:07:35.225450 9118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:35.226799 9101 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:07:35.226967 9101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "2161bf98f722458ab5c0320e820cd9f8"
format_stamp: "Formatted at 2026-08-11 05:07:35 on dist-test-slave-w206"
server_key: "08bdf1d82c1592dd743c1dd7fce7978b"
server_key_iv: "c9e70b37642de397982b2b156678664c"
server_key_version: "encryptionkey@0"
I20260811 05:07:35.227145 9101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:35.259305 9101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:35.262778 9101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:35.263052 9101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:35.263679 9101 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:35.264544 9101 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:35.264592 9101 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:35.264662 9101 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:35.264693 9101 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:35.273808 9101 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:41029
I20260811 05:07:35.273823 9236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:41029 every 8 connection(s)
I20260811 05:07:35.274725 9101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:07:35.276691 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 9101
I20260811 05:07:35.276831 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:07:35.277161 22727 external_mini_cluster.cc:1428] Setting key 2297dbf2063fb8f75e1637fdd6cdbda1
Aug 11 05:07:35 dist-test-slave-w206 krb5kdc[8986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424855, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:07:35.290464 9076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.276588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:56845 (local address 127.22.49.254:39855)
0811 05:07:35.276727 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:35.276738 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:35.277770 (+ 1032us) server_negotiation.cc:407] Connection header received
0811 05:07:35.279368 (+ 1598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:35.279374 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:35.279432 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:35.279528 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:35.280731 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.281280 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.282450 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.282864 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.283015 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.285952 (+ 2937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:35.285956 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:35.285959 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:35.285994 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:35.288045 (+ 2051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:35.288667 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:35.288672 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:35.288674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:35.288776 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:35.289176 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:35.289180 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:35.289182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:35.289402 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:35.289527 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:35.290091 (+ 564us) server_negotiation.cc:299] Negotiation successful
0811 05:07:35.290265 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 05:07:35.291414 9239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.277061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39855 (local address 127.22.49.193:56845)
0811 05:07:35.277577 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:35.277638 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:35.279162 (+ 1524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:35.279692 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:35.279698 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:35.280058 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:35.280579 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.280592 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.281416 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.281424 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.282304 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.282323 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.283136 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.283140 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.283323 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.284029 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:35.284048 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:35.285763 (+ 1715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:35.288186 (+ 2423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:35.288192 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:35.288205 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:35.288509 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:35.288892 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:35.288897 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:35.288899 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:35.289057 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:35.289527 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:35.289535 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:35.289829 (+ 294us) client_negotiation.cc:769] Sending connection context
0811 05:07:35.290045 (+ 216us) client_negotiation.cc:240] Negotiation successful
0811 05:07:35.290394 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":150,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
I20260811 05:07:35.292873 9237 heartbeater.cc:347] Connected to a master server at 127.22.49.254:39855
I20260811 05:07:35.293151 9237 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:35.293849 9237 heartbeater.cc:511] Master 127.22.49.254:39855 requested a full tablet report, sending...
I20260811 05:07:35.295629 9034 ts_manager.cc:194] Registered new tserver with Master: 2161bf98f722458ab5c0320e820cd9f8 (127.22.49.193:41029)
I20260811 05:07:35.296845 9034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:56845
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:07:35.311093 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:39855
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:37741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:35.423775 9242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:35.424101 9242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:35.424182 9242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:35.428166 9242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:35.428257 9242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:35.428357 9242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:07:35.433801 9242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:37741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:39855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:35.434878 9242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:35.435920 9242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:35.445652 9249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:35.445766 9252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:35.445673 9250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:35.445819 9242 server_base.cc:1034] running on GCE node
I20260811 05:07:35.446476 9242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:35.447185 9242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:35.448387 9242 hybrid_clock.cc:648] HybridClock initialized: now 1786424855448372 us; error 37 us; skew 500 ppm
Aug 11 05:07:35 dist-test-slave-w206 krb5kdc[8986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424855, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:35.451360 9242 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:07:35.452270 9242 webserver.cc:460] Webserver started at http://127.22.49.194:35293/ using document root <none> and password file <none>
I20260811 05:07:35.452849 9242 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:35.452942 9242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:35.453179 9242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:35.455286 9242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "5727323a3e0f49c18dac43840548dc7f"
format_stamp: "Formatted at 2026-08-11 05:07:35 on dist-test-slave-w206"
server_key: "5718031502b3952005bfbe76dba24123"
server_key_iv: "0024c31fee0bed198b9ae2dedce85b38"
server_key_version: "encryptionkey@0"
I20260811 05:07:35.455912 9242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "5727323a3e0f49c18dac43840548dc7f"
format_stamp: "Formatted at 2026-08-11 05:07:35 on dist-test-slave-w206"
server_key: "5718031502b3952005bfbe76dba24123"
server_key_iv: "0024c31fee0bed198b9ae2dedce85b38"
server_key_version: "encryptionkey@0"
I20260811 05:07:35.460017 9242 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:07:35.462561 9259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:35.463901 9242 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:07:35.464052 9242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "5727323a3e0f49c18dac43840548dc7f"
format_stamp: "Formatted at 2026-08-11 05:07:35 on dist-test-slave-w206"
server_key: "5718031502b3952005bfbe76dba24123"
server_key_iv: "0024c31fee0bed198b9ae2dedce85b38"
server_key_version: "encryptionkey@0"
I20260811 05:07:35.464169 9242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:35.494329 9242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:35.497774 9242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:35.498013 9242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:35.498670 9242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:35.499620 9242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:35.499696 9242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:35.499768 9242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:35.499821 9242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:35.509441 9242 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:34999
I20260811 05:07:35.509462 9380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:34999 every 8 connection(s)
I20260811 05:07:35.510376 9242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:07:35.519243 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 9242
I20260811 05:07:35.519392 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:07:35.519707 22727 external_mini_cluster.cc:1428] Setting key 7d32293f2899bf0a2f95945cf1886b09
Aug 11 05:07:35 dist-test-slave-w206 krb5kdc[8986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424855, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:07:35.525041 9076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.512258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:36881 (local address 127.22.49.254:39855)
0811 05:07:35.512431 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:35.512434 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:35.513325 (+ 891us) server_negotiation.cc:407] Connection header received
0811 05:07:35.514715 (+ 1390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:35.514718 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:35.514775 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:35.514857 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:35.516082 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.516643 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.517862 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.518107 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.518250 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.521210 (+ 2960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:35.521214 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:35.521216 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:35.521244 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:35.522852 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:35.523416 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:35.523420 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:35.523422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:35.523514 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:35.523900 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:35.523904 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:35.523906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:35.524116 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:35.524230 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:35.524748 (+ 518us) server_negotiation.cc:299] Negotiation successful
0811 05:07:35.524878 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 05:07:35.525988 9383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.512677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39855 (local address 127.22.49.194:36881)
0811 05:07:35.513142 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:35.513186 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:35.514500 (+ 1314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:35.515077 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:35.515084 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:35.515452 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:35.515932 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.515945 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.516795 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.516798 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.517723 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.517734 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.518270 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.518275 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.518460 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.519147 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:35.519164 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:35.521047 (+ 1883us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:35.522995 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:35.523004 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:35.523022 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:35.523307 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:35.523618 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:35.523621 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:35.523624 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:35.523785 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:35.524229 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:35.524238 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:35.524497 (+ 259us) client_negotiation.cc:769] Sending connection context
0811 05:07:35.524688 (+ 191us) client_negotiation.cc:240] Negotiation successful
0811 05:07:35.525040 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":124,"threads_started":1}
I20260811 05:07:35.527437 9381 heartbeater.cc:347] Connected to a master server at 127.22.49.254:39855
I20260811 05:07:35.527716 9381 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:35.528254 9381 heartbeater.cc:511] Master 127.22.49.254:39855 requested a full tablet report, sending...
I20260811 05:07:35.529497 9034 ts_manager.cc:194] Registered new tserver with Master: 5727323a3e0f49c18dac43840548dc7f (127.22.49.194:34999)
I20260811 05:07:35.530112 9034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:36881
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:07:35.551317 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:39855
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:37741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:35.670012 9386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:35.670291 9386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:35.670375 9386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:35.674528 9386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:35.674603 9386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:35.674705 9386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:07:35.680451 9386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:37741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:39855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:35.681574 9386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:35.682646 9386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:35.692770 9394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:35.692761 9392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:35.692866 9386 server_base.cc:1034] running on GCE node
W20260811 05:07:35.693018 9391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:35.693426 9386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:35.694142 9386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:35.695348 9386 hybrid_clock.cc:648] HybridClock initialized: now 1786424855695304 us; error 28 us; skew 500 ppm
Aug 11 05:07:35 dist-test-slave-w206 krb5kdc[8986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424855, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:35.698137 9386 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:07:35.699229 9386 webserver.cc:460] Webserver started at http://127.22.49.195:36739/ using document root <none> and password file <none>
I20260811 05:07:35.699801 9386 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:35.699893 9386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:35.700143 9386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:35.702179 9386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "037a3721ca9a416f8f020bdd56f27585"
format_stamp: "Formatted at 2026-08-11 05:07:35 on dist-test-slave-w206"
server_key: "7025a0865c24099c39cad09d1e9be0b6"
server_key_iv: "845849ebee9fd252051518a01bd83fe9"
server_key_version: "encryptionkey@0"
I20260811 05:07:35.702780 9386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "037a3721ca9a416f8f020bdd56f27585"
format_stamp: "Formatted at 2026-08-11 05:07:35 on dist-test-slave-w206"
server_key: "7025a0865c24099c39cad09d1e9be0b6"
server_key_iv: "845849ebee9fd252051518a01bd83fe9"
server_key_version: "encryptionkey@0"
I20260811 05:07:35.706538 9386 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 05:07:35.709089 9402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:35.710270 9386 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:07:35.710439 9386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "037a3721ca9a416f8f020bdd56f27585"
format_stamp: "Formatted at 2026-08-11 05:07:35 on dist-test-slave-w206"
server_key: "7025a0865c24099c39cad09d1e9be0b6"
server_key_iv: "845849ebee9fd252051518a01bd83fe9"
server_key_version: "encryptionkey@0"
I20260811 05:07:35.710557 9386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:35.727342 9386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:35.731058 9386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:35.731350 9386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:35.732013 9386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:35.732913 9386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:35.732990 9386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:35.733067 9386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:35.733124 9386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:35.743081 9386 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:38673
I20260811 05:07:35.743112 9526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:38673 every 8 connection(s)
I20260811 05:07:35.744074 9386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:07:35.749439 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 9386
I20260811 05:07:35.749577 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:07:35.749869 22727 external_mini_cluster.cc:1428] Setting key 5a0f8aac760e23b613e0fab734b1ca9c
Aug 11 05:07:35 dist-test-slave-w206 krb5kdc[8986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424855, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:07:35.758797 9076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.745995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:56403 (local address 127.22.49.254:39855)
0811 05:07:35.746151 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:35.746155 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:35.746990 (+ 835us) server_negotiation.cc:407] Connection header received
0811 05:07:35.748551 (+ 1561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:35.748556 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:35.748621 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:35.748707 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:35.750092 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.750774 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.752173 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.752402 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.752507 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.755162 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:35.755170 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:35.755172 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:35.755196 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:35.756640 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:35.757186 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:35.757189 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:35.757191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:35.757266 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:35.757691 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:35.757694 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:35.757695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:35.757905 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:35.758021 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:35.758568 (+ 547us) server_negotiation.cc:299] Negotiation successful
0811 05:07:35.758672 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 05:07:35.759632 9529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.746334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39855 (local address 127.22.49.195:56403)
0811 05:07:35.746813 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:35.746860 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:35.748313 (+ 1453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:35.748899 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:35.748907 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:35.749271 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:35.749920 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.749945 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.750920 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.750923 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.752052 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.752061 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.752560 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.752564 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.752730 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.753363 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:35.753381 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:35.754942 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:35.756755 (+ 1813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:35.756761 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:35.756776 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:35.757070 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:35.757428 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:35.757431 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:35.757432 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:35.757602 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:35.758073 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:35.758078 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:35.758309 (+ 231us) client_negotiation.cc:769] Sending connection context
0811 05:07:35.758462 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 05:07:35.758712 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":122,"threads_started":1}
I20260811 05:07:35.760859 9527 heartbeater.cc:347] Connected to a master server at 127.22.49.254:39855
I20260811 05:07:35.761108 9527 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:35.761591 9527 heartbeater.cc:511] Master 127.22.49.254:39855 requested a full tablet report, sending...
I20260811 05:07:35.762679 9034 ts_manager.cc:194] Registered new tserver with Master: 037a3721ca9a416f8f020bdd56f27585 (127.22.49.195:38673)
I20260811 05:07:35.763340 9034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:56403
I20260811 05:07:35.764261 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:07:35.774375 9076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.766582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44968 (local address 127.22.49.254:39855)
0811 05:07:35.766708 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:35.766716 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:35.766892 (+ 176us) server_negotiation.cc:407] Connection header received
0811 05:07:35.767078 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:35.767080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:35.767118 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:35.767183 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:35.768028 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.768626 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.769530 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.769731 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.769825 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.771344 (+ 1519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:35.771347 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:35.771350 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:35.771372 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:35.772861 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:35.773289 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:35.773292 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:35.773293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:35.773367 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:35.773609 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:35.773611 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:35.773612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:35.773836 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:35.773940 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:35.774162 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 05:07:35.774255 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 05:07:35.777369 9034 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44968:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:07:35.780728 9034 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:35.795907 9542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.790182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:38673 (local address 127.0.0.1:41144)
0811 05:07:35.791221 (+ 1039us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:35.791234 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:35.791348 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:35.791778 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:35.791781 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:35.791810 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:35.791958 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.791969 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.793047 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.793050 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.794366 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.794377 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.795369 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.795372 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.795477 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.795514 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 05:07:35.795626 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 05:07:35.795751 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":980,"mutex_wait_us":26,"spinlock_wait_cycles":1280,"thread_start_us":136,"threads_started":1}
I20260811 05:07:35.795912 9543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.790433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41144 (local address 127.22.49.195:38673)
0811 05:07:35.791185 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:35.791196 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:35.791345 (+ 149us) server_negotiation.cc:407] Connection header received
0811 05:07:35.791452 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:35.791460 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:35.791627 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:35.791776 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:35.792126 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.792830 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.794489 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.795242 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.795368 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.795524 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:35.795653 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 05:07:35.795751 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":157,"threads_started":1}
I20260811 05:07:35.796440 9538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.789420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:41029 (local address 127.0.0.1:34962)
0811 05:07:35.790730 (+ 1310us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:35.790786 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:35.790933 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:35.791745 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:35.791748 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:35.791763 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:35.791903 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.791909 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.793267 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.793271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.794665 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.794676 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.795984 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.795988 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.796121 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.796142 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 05:07:35.796208 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 05:07:35.796271 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1133,"mutex_wait_us":143,"spinlock_wait_cycles":5504,"thread_start_us":105,"threads_started":1}
I20260811 05:07:35.796978 9541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.790085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44892 (local address 127.22.49.194:34999)
0811 05:07:35.790937 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:35.790949 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:35.791001 (+ 52us) server_negotiation.cc:407] Connection header received
0811 05:07:35.791144 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:35.791150 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:35.791380 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:35.791542 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:35.791892 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.793175 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.794822 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.795675 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.795782 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.795911 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:35.796714 (+ 803us) server_negotiation.cc:299] Negotiation successful
0811 05:07:35.796843 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":744,"thread_start_us":218,"threads_started":1}
I20260811 05:07:35.796620 9540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.789639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:34999 (local address 127.0.0.1:44892)
0811 05:07:35.790730 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:35.790786 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:35.790933 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:35.791560 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:35.791567 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:35.791590 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:35.791741 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.791748 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.793309 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.793312 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.794668 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.794676 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.795978 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.795982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.796328 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.796350 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 05:07:35.796414 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 05:07:35.796486 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1043,"mutex_wait_us":315,"spinlock_wait_cycles":6784,"thread_start_us":97,"threads_started":1}
I20260811 05:07:35.797158 9539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.789588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34962 (local address 127.22.49.193:41029)
0811 05:07:35.790612 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:35.790628 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:35.791101 (+ 473us) server_negotiation.cc:407] Connection header received
0811 05:07:35.791186 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:35.791191 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:35.791440 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:35.791610 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:35.792030 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.793128 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.794811 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.795675 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.795782 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.795911 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:35.796906 (+ 995us) server_negotiation.cc:299] Negotiation successful
0811 05:07:35.797006 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":915,"thread_start_us":96,"threads_started":1}
I20260811 05:07:35.799480 9167 tablet_service.cc:1467] Processing CreateTablet for tablet fb225b4cf67841f783af83e768259b97 (DEFAULT_TABLE table=test-table [id=49bbdedc5434436a8b07123fce853dda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:35.800559 9167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb225b4cf67841f783af83e768259b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:35.800280 9458 tablet_service.cc:1467] Processing CreateTablet for tablet fb225b4cf67841f783af83e768259b97 (DEFAULT_TABLE table=test-table [id=49bbdedc5434436a8b07123fce853dda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:35.800684 9309 tablet_service.cc:1467] Processing CreateTablet for tablet fb225b4cf67841f783af83e768259b97 (DEFAULT_TABLE table=test-table [id=49bbdedc5434436a8b07123fce853dda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:35.801270 9458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb225b4cf67841f783af83e768259b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:35.801523 9309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb225b4cf67841f783af83e768259b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:35.807718 9544 tablet_bootstrap.cc:492] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f: Bootstrap starting.
I20260811 05:07:35.808393 9546 tablet_bootstrap.cc:492] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585: Bootstrap starting.
I20260811 05:07:35.808393 9545 tablet_bootstrap.cc:492] T fb225b4cf67841f783af83e768259b97 P 2161bf98f722458ab5c0320e820cd9f8: Bootstrap starting.
I20260811 05:07:35.810503 9544 tablet_bootstrap.cc:654] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:35.810609 9545 tablet_bootstrap.cc:654] T fb225b4cf67841f783af83e768259b97 P 2161bf98f722458ab5c0320e820cd9f8: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:35.810609 9546 tablet_bootstrap.cc:654] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:35.811677 9545 log.cc:824] T fb225b4cf67841f783af83e768259b97 P 2161bf98f722458ab5c0320e820cd9f8: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:35.811914 9546 log.cc:824] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:35.812361 9544 log.cc:824] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:35.813835 9545 tablet_bootstrap.cc:492] T fb225b4cf67841f783af83e768259b97 P 2161bf98f722458ab5c0320e820cd9f8: No bootstrap required, opened a new log
I20260811 05:07:35.813856 9546 tablet_bootstrap.cc:492] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585: No bootstrap required, opened a new log
I20260811 05:07:35.814049 9546 ts_tablet_manager.cc:1397] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260811 05:07:35.814049 9545 ts_tablet_manager.cc:1397] T fb225b4cf67841f783af83e768259b97 P 2161bf98f722458ab5c0320e820cd9f8: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260811 05:07:35.814203 9544 tablet_bootstrap.cc:492] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f: No bootstrap required, opened a new log
I20260811 05:07:35.814502 9544 ts_tablet_manager.cc:1397] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260811 05:07:35.818111 9546 raft_consensus.cc:348] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2161bf98f722458ab5c0320e820cd9f8" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41029 } } peers { permanent_uuid: "5727323a3e0f49c18dac43840548dc7f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34999 } } peers { permanent_uuid: "037a3721ca9a416f8f020bdd56f27585" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38673 } }
I20260811 05:07:35.817898 9544 raft_consensus.cc:348] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2161bf98f722458ab5c0320e820cd9f8" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41029 } } peers { permanent_uuid: "5727323a3e0f49c18dac43840548dc7f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34999 } } peers { permanent_uuid: "037a3721ca9a416f8f020bdd56f27585" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38673 } }
I20260811 05:07:35.818375 9546 raft_consensus.cc:374] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:35.818427 9546 raft_consensus.cc:729] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 037a3721ca9a416f8f020bdd56f27585, State: Initialized, Role: FOLLOWER
I20260811 05:07:35.818429 9544 raft_consensus.cc:374] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:35.818490 9544 raft_consensus.cc:729] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5727323a3e0f49c18dac43840548dc7f, State: Initialized, Role: FOLLOWER
I20260811 05:07:35.818493 9545 raft_consensus.cc:348] T fb225b4cf67841f783af83e768259b97 P 2161bf98f722458ab5c0320e820cd9f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2161bf98f722458ab5c0320e820cd9f8" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41029 } } peers { permanent_uuid: "5727323a3e0f49c18dac43840548dc7f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34999 } } peers { permanent_uuid: "037a3721ca9a416f8f020bdd56f27585" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38673 } }
I20260811 05:07:35.818720 9545 raft_consensus.cc:374] T fb225b4cf67841f783af83e768259b97 P 2161bf98f722458ab5c0320e820cd9f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:35.818768 9545 raft_consensus.cc:729] T fb225b4cf67841f783af83e768259b97 P 2161bf98f722458ab5c0320e820cd9f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2161bf98f722458ab5c0320e820cd9f8, State: Initialized, Role: FOLLOWER
I20260811 05:07:35.818909 9546 consensus_queue.cc:260] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2161bf98f722458ab5c0320e820cd9f8" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41029 } } peers { permanent_uuid: "5727323a3e0f49c18dac43840548dc7f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34999 } } peers { permanent_uuid: "037a3721ca9a416f8f020bdd56f27585" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38673 } }
I20260811 05:07:35.818977 9544 consensus_queue.cc:260] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2161bf98f722458ab5c0320e820cd9f8" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41029 } } peers { permanent_uuid: "5727323a3e0f49c18dac43840548dc7f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34999 } } peers { permanent_uuid: "037a3721ca9a416f8f020bdd56f27585" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38673 } }
I20260811 05:07:35.819480 9545 consensus_queue.cc:260] T fb225b4cf67841f783af83e768259b97 P 2161bf98f722458ab5c0320e820cd9f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2161bf98f722458ab5c0320e820cd9f8" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41029 } } peers { permanent_uuid: "5727323a3e0f49c18dac43840548dc7f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34999 } } peers { permanent_uuid: "037a3721ca9a416f8f020bdd56f27585" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38673 } }
I20260811 05:07:35.819648 9527 heartbeater.cc:503] Master 127.22.49.254:39855 was elected leader, sending a full tablet report...
I20260811 05:07:35.820031 9544 ts_tablet_manager.cc:1428] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260811 05:07:35.820065 9546 ts_tablet_manager.cc:1428] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 05:07:35.820358 9381 heartbeater.cc:503] Master 127.22.49.254:39855 was elected leader, sending a full tablet report...
I20260811 05:07:35.820614 9545 ts_tablet_manager.cc:1428] T fb225b4cf67841f783af83e768259b97 P 2161bf98f722458ab5c0320e820cd9f8: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20260811 05:07:35.820663 9237 heartbeater.cc:503] Master 127.22.49.254:39855 was elected leader, sending a full tablet report...
I20260811 05:07:35.967490 9551 raft_consensus.cc:482] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:35.967715 9551 raft_consensus.cc:504] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2161bf98f722458ab5c0320e820cd9f8" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41029 } } peers { permanent_uuid: "5727323a3e0f49c18dac43840548dc7f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34999 } } peers { permanent_uuid: "037a3721ca9a416f8f020bdd56f27585" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38673 } }
I20260811 05:07:35.968990 9551 leader_election.cc:288] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2161bf98f722458ab5c0320e820cd9f8 (127.22.49.193:41029), 037a3721ca9a416f8f020bdd56f27585 (127.22.49.195:38673)
I20260811 05:07:35.973068 9543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.969520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:48935 (local address 127.22.49.195:38673)
0811 05:07:35.969652 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:35.969655 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:35.969921 (+ 266us) server_negotiation.cc:407] Connection header received
0811 05:07:35.970013 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:35.970016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:35.970067 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:35.970159 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:35.970457 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.970924 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.972027 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.972469 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.972565 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.972633 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:35.972855 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 05:07:35.972935 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 05:07:35.973054 9553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.969283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:38673 (local address 127.22.49.194:48935)
0811 05:07:35.969735 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:35.969749 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:35.969931 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:35.970175 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:35.970178 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:35.970192 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:35.970342 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.970348 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.971066 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.971069 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.971896 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.971905 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.972598 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.972605 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.972705 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.972736 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 05:07:35.972807 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 05:07:35.972890 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":2,"thread_start_us":144,"threads_started":1}
I20260811 05:07:35.973078 9383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.969194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:41029 (local address 127.22.49.194:35325)
0811 05:07:35.969339 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:35.969356 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:35.969466 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:35.970005 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:35.970009 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:35.970032 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:35.970178 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.970188 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.971041 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.971044 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.971914 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:35.971923 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.972689 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.972692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:35.972771 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.972817 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 05:07:35.972897 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 05:07:35.972962 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":24}
I20260811 05:07:35.973146 9539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:35.969537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:35325 (local address 127.22.49.193:41029)
0811 05:07:35.969676 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:35.969681 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:35.969697 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:07:35.969758 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:35.969763 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:35.969829 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:35.969969 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:35.970301 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.970867 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.972071 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:35.972543 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:35.972663 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:35.972711 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:35.972934 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 05:07:35.973014 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 05:07:35.973919 9478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb225b4cf67841f783af83e768259b97" candidate_uuid: "5727323a3e0f49c18dac43840548dc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "037a3721ca9a416f8f020bdd56f27585" is_pre_election: true
I20260811 05:07:35.973918 9187 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb225b4cf67841f783af83e768259b97" candidate_uuid: "5727323a3e0f49c18dac43840548dc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2161bf98f722458ab5c0320e820cd9f8" is_pre_election: true
I20260811 05:07:35.974244 9478 raft_consensus.cc:2454] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727323a3e0f49c18dac43840548dc7f in term 0.
I20260811 05:07:35.974244 9187 raft_consensus.cc:2454] T fb225b4cf67841f783af83e768259b97 P 2161bf98f722458ab5c0320e820cd9f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5727323a3e0f49c18dac43840548dc7f in term 0.
I20260811 05:07:35.974742 9261 leader_election.cc:302] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 037a3721ca9a416f8f020bdd56f27585, 5727323a3e0f49c18dac43840548dc7f; no voters:
I20260811 05:07:35.975077 9551 raft_consensus.cc:2781] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:35.975188 9551 raft_consensus.cc:482] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:35.975270 9551 raft_consensus.cc:3037] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:35.976490 9551 raft_consensus.cc:504] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2161bf98f722458ab5c0320e820cd9f8" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41029 } } peers { permanent_uuid: "5727323a3e0f49c18dac43840548dc7f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34999 } } peers { permanent_uuid: "037a3721ca9a416f8f020bdd56f27585" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38673 } }
I20260811 05:07:35.976886 9551 leader_election.cc:288] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [CANDIDATE]: Term 1 election: Requested vote from peers 2161bf98f722458ab5c0320e820cd9f8 (127.22.49.193:41029), 037a3721ca9a416f8f020bdd56f27585 (127.22.49.195:38673)
I20260811 05:07:35.977226 9187 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb225b4cf67841f783af83e768259b97" candidate_uuid: "5727323a3e0f49c18dac43840548dc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2161bf98f722458ab5c0320e820cd9f8"
I20260811 05:07:35.977240 9478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb225b4cf67841f783af83e768259b97" candidate_uuid: "5727323a3e0f49c18dac43840548dc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "037a3721ca9a416f8f020bdd56f27585"
I20260811 05:07:35.977375 9478 raft_consensus.cc:3037] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:35.977382 9187 raft_consensus.cc:3037] T fb225b4cf67841f783af83e768259b97 P 2161bf98f722458ab5c0320e820cd9f8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:35.978473 9187 raft_consensus.cc:2454] T fb225b4cf67841f783af83e768259b97 P 2161bf98f722458ab5c0320e820cd9f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727323a3e0f49c18dac43840548dc7f in term 1.
I20260811 05:07:35.978549 9478 raft_consensus.cc:2454] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5727323a3e0f49c18dac43840548dc7f in term 1.
I20260811 05:07:35.978832 9260 leader_election.cc:302] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2161bf98f722458ab5c0320e820cd9f8, 5727323a3e0f49c18dac43840548dc7f; no voters:
I20260811 05:07:35.979079 9551 raft_consensus.cc:2781] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:35.979354 9551 raft_consensus.cc:686] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [term 1 LEADER]: Becoming Leader. State: Replica: 5727323a3e0f49c18dac43840548dc7f, State: Running, Role: LEADER
I20260811 05:07:35.979694 9551 consensus_queue.cc:237] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2161bf98f722458ab5c0320e820cd9f8" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41029 } } peers { permanent_uuid: "5727323a3e0f49c18dac43840548dc7f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34999 } } peers { permanent_uuid: "037a3721ca9a416f8f020bdd56f27585" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38673 } }
I20260811 05:07:35.983161 9034 catalog_manager.cc:5495] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5727323a3e0f49c18dac43840548dc7f (127.22.49.194). New cstate: current_term: 1 leader_uuid: "5727323a3e0f49c18dac43840548dc7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2161bf98f722458ab5c0320e820cd9f8" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5727323a3e0f49c18dac43840548dc7f" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "037a3721ca9a416f8f020bdd56f27585" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38673 } health_report { overall_health: UNKNOWN } } }
W20260811 05:07:35.995265 9528 tablet.cc:2369] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:07:36.011700 9382 tablet.cc:2369] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:07:36.026242 9238 tablet.cc:2369] T fb225b4cf67841f783af83e768259b97 P 2161bf98f722458ab5c0320e820cd9f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:07:36.032557 9541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.028481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44906 (local address 127.22.49.194:34999)
0811 05:07:36.028634 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:36.028640 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:36.028658 (+ 18us) server_negotiation.cc:407] Connection header received
0811 05:07:36.028808 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:36.028810 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:36.028875 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:36.029002 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:36.029275 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.029799 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.030697 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.031080 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.031216 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:36.031559 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:36.032054 (+ 495us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:36.032209 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:36.032293 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 05:07:36.032358 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 05:07:36.038911 9478 raft_consensus.cc:1261] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585 [term 1 FOLLOWER]: Refusing update from remote peer 5727323a3e0f49c18dac43840548dc7f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:36.038919 9187 raft_consensus.cc:1261] T fb225b4cf67841f783af83e768259b97 P 2161bf98f722458ab5c0320e820cd9f8 [term 1 FOLLOWER]: Refusing update from remote peer 5727323a3e0f49c18dac43840548dc7f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:36.039742 9554 consensus_queue.cc:1035] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "037a3721ca9a416f8f020bdd56f27585" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 38673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:36.039909 9551 consensus_queue.cc:1035] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2161bf98f722458ab5c0320e820cd9f8" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:36.049361 9560 mvcc.cc:205] Tried to move back new op lower bound from 7317196210326798336 to 7317196210095783936. Current Snapshot: MvccSnapshot[applied={T|T < 7317196210326798336}]
I20260811 05:07:36.049784 9559 mvcc.cc:205] Tried to move back new op lower bound from 7317196210326798336 to 7317196210095783936. Current Snapshot: MvccSnapshot[applied={T|T < 7317196210326798336}]
I20260811 05:07:36.059393 9032 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:36.059599 9032 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:36.062299 9032 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 113c62488bc0444082bd717964d0f1a6: Sending DeleteTablet for 3 replicas of tablet fb225b4cf67841f783af83e768259b97
I20260811 05:07:36.063624 9458 tablet_service.cc:1514] Processing DeleteTablet for tablet fb225b4cf67841f783af83e768259b97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:36 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:41144
I20260811 05:07:36.063623 9309 tablet_service.cc:1514] Processing DeleteTablet for tablet fb225b4cf67841f783af83e768259b97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:36 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:44892
I20260811 05:07:36.064536 9570 tablet_replica.cc:330] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585: stopping tablet replica
I20260811 05:07:36.064947 9570 raft_consensus.cc:2229] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:36.065317 9570 raft_consensus.cc:2258] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:36.066222 9167 tablet_service.cc:1514] Processing DeleteTablet for tablet fb225b4cf67841f783af83e768259b97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:36 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:34962
I20260811 05:07:36.066856 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 9101
I20260811 05:07:36.068324 9570 ts_tablet_manager.cc:1905] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:36.071913 9570 ts_tablet_manager.cc:1918] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:36.072086 9570 log.cc:1196] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/fb225b4cf67841f783af83e768259b97
I20260811 05:07:36.072527 9570 ts_tablet_manager.cc:1939] T fb225b4cf67841f783af83e768259b97 P 037a3721ca9a416f8f020bdd56f27585: Deleting consensus metadata
I20260811 05:07:36.073781 9571 tablet_replica.cc:330] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f: stopping tablet replica
I20260811 05:07:36.074225 9571 raft_consensus.cc:2229] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:07:36.074190 9016 catalog_manager.cc:4841] TS 037a3721ca9a416f8f020bdd56f27585 (127.22.49.195:38673): tablet fb225b4cf67841f783af83e768259b97 (table test-table [id=49bbdedc5434436a8b07123fce853dda]) successfully deleted
I20260811 05:07:36.074741 9571 raft_consensus.cc:2258] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:36.076280 9571 ts_tablet_manager.cc:1905] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:36.080085 9571 ts_tablet_manager.cc:1918] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:36.080204 9571 log.cc:1196] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/fb225b4cf67841f783af83e768259b97
I20260811 05:07:36.080631 9571 ts_tablet_manager.cc:1939] T fb225b4cf67841f783af83e768259b97 P 5727323a3e0f49c18dac43840548dc7f: Deleting consensus metadata
W20260811 05:07:36.081382 9015 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:41029 (error 108)
I20260811 05:07:36.082011 9016 catalog_manager.cc:4841] TS 5727323a3e0f49c18dac43840548dc7f (127.22.49.194:34999): tablet fb225b4cf67841f783af83e768259b97 (table test-table [id=49bbdedc5434436a8b07123fce853dda]) successfully deleted
I20260811 05:07:36.082556 9540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.082228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:41029 (local address 127.0.0.1:34978)
0811 05:07:36.082380 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:36.082461 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:41029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 05:07:36.082641 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 9242
W20260811 05:07:36.084528 9015 catalog_manager.cc:4584] TS 2161bf98f722458ab5c0320e820cd9f8 (127.22.49.193:41029): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fb225b4cf67841f783af83e768259b97: Network error: Client connection negotiation failed: client connection to 127.22.49.193:41029: connect: Connection refused (error 111)
I20260811 05:07:36.089658 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 9386
I20260811 05:07:36.097165 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 8999
2026-08-11T05:07:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2605 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T05:07:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:36Z Disabled control of system clock
I20260811 05:07:36.133550 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:35605
--webserver_interface=127.22.49.254
--webserver_port=0
--builtin_ntp_servers=127.22.49.212:44033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:35605
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 05:07:36.253736 9580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:36.254022 9580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:36.254058 9580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:36.258085 9580 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:36.258158 9580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:36.258173 9580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:36.258191 9580 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:36.258206 9580 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:36.263288 9580 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:44033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:35605
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:35605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:36.264354 9580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:36.265687 9580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:36.274670 9589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:36.274691 9586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:36.274681 9587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:36.274854 9580 server_base.cc:1034] running on GCE node
I20260811 05:07:36.275579 9580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:36.276774 9580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:36.277987 9580 hybrid_clock.cc:648] HybridClock initialized: now 1786424856277974 us; error 31 us; skew 500 ppm
I20260811 05:07:36.280167 9580 webserver.cc:460] Webserver started at http://127.22.49.254:42937/ using document root <none> and password file <none>
I20260811 05:07:36.280768 9580 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:36.280872 9580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:36.281118 9580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:36.283347 9580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "8b8ebf03b8f2451798031e10710530a8"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-w206"
server_key: "bbdfc864fa63017c21d0b2cdc1dbf358"
server_key_iv: "000a82749d808c26cdd9d3867bfeb9fe"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.283943 9580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "8b8ebf03b8f2451798031e10710530a8"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-w206"
server_key: "bbdfc864fa63017c21d0b2cdc1dbf358"
server_key_iv: "000a82749d808c26cdd9d3867bfeb9fe"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.287730 9580 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 05:07:36.290256 9596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.291587 9580 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:07:36.291734 9580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "8b8ebf03b8f2451798031e10710530a8"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-w206"
server_key: "bbdfc864fa63017c21d0b2cdc1dbf358"
server_key_iv: "000a82749d808c26cdd9d3867bfeb9fe"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.291859 9580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:36.319885 9580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:36.320690 9580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:36.320911 9580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:36.328658 9580 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:35605
I20260811 05:07:36.328694 9650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:35605 every 8 connection(s)
I20260811 05:07:36.329643 9580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:36.330571 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 9580
I20260811 05:07:36.330708 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:07:36.331087 22727 external_mini_cluster.cc:1428] Setting key 91f5e24ed0492b560bfa98e7ebf1d972
I20260811 05:07:36.333400 9651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:36.339047 9651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8: Bootstrap starting.
I20260811 05:07:36.341059 9654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.332670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60862 (local address 127.22.49.254:35605)
0811 05:07:36.333393 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:36.333411 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:36.333449 (+ 38us) server_negotiation.cc:407] Connection header received
0811 05:07:36.334172 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:36.334188 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:36.334580 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:36.334929 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:36.335393 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.336408 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.337359 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.337846 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.338040 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:36.339104 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:36.339109 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:36.339122 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:36.339606 (+ 484us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:36.339665 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:36.339687 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:36.339813 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:36.339998 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 05:07:36.340315 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":158,"threads_started":1}
I20260811 05:07:36.341457 9651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:36.342307 9651 log.cc:824] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:36.344439 9651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8: No bootstrap required, opened a new log
I20260811 05:07:36.348127 9651 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8ebf03b8f2451798031e10710530a8" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35605 } }
I20260811 05:07:36.348392 9651 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:36.348474 9651 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b8ebf03b8f2451798031e10710530a8, State: Initialized, Role: FOLLOWER
I20260811 05:07:36.348942 9651 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8ebf03b8f2451798031e10710530a8" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35605 } }
I20260811 05:07:36.349094 9651 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:36.349166 9651 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:36.349268 9651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:36.350231 9651 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8ebf03b8f2451798031e10710530a8" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35605 } }
I20260811 05:07:36.350585 9651 leader_election.cc:302] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b8ebf03b8f2451798031e10710530a8; no voters:
I20260811 05:07:36.350915 9651 leader_election.cc:288] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:36.351112 9656 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:36.351675 9656 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [term 1 LEADER]: Becoming Leader. State: Replica: 8b8ebf03b8f2451798031e10710530a8, State: Running, Role: LEADER
I20260811 05:07:36.352064 9656 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8ebf03b8f2451798031e10710530a8" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35605 } }
I20260811 05:07:36.352262 9651 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:36.353623 9658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b8ebf03b8f2451798031e10710530a8. Latest consensus state: current_term: 1 leader_uuid: "8b8ebf03b8f2451798031e10710530a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8ebf03b8f2451798031e10710530a8" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35605 } } }
I20260811 05:07:36.353753 9658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:36.354099 9657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b8ebf03b8f2451798031e10710530a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8ebf03b8f2451798031e10710530a8" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35605 } } }
I20260811 05:07:36.354208 9657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8 [sys.catalog]: This master's current role is: LEADER
W20260811 05:07:36.357615 9674 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:07:36.357689 9674 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:07:36.357782 9669 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:36.358484 9669 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:36.365242 9669 catalog_manager.cc:1347] Generated new cluster ID: 996b7fc113ec48bd8f6276f842c8a8f2
I20260811 05:07:36.365322 9669 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:36.381228 9669 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:36.382627 9669 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:36.391012 9669 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8: Generated new TSK 0
I20260811 05:07:36.391877 9669 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:07:36.397758 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35605
--builtin_ntp_servers=127.22.49.212:44033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 05:07:36.516938 9678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:36.517262 9678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:36.517307 9678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:36.521435 9678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:36.521500 9678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:36.521561 9678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:07:36.526912 9678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:44033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:36.528090 9678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:36.529490 9678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:36.539800 9686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:36.539786 9684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:36.539788 9683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:36.540230 9678 server_base.cc:1034] running on GCE node
I20260811 05:07:36.540663 9678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:36.541366 9678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:36.542584 9678 hybrid_clock.cc:648] HybridClock initialized: now 1786424856542573 us; error 34 us; skew 500 ppm
I20260811 05:07:36.544588 9678 webserver.cc:460] Webserver started at http://127.22.49.193:40577/ using document root <none> and password file <none>
I20260811 05:07:36.545184 9678 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:36.545292 9678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:36.545528 9678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:36.547681 9678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "69e20f4db23e48aea71436d31da26d2d"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-w206"
server_key: "2dc2232beff66876cf383f23c93154a3"
server_key_iv: "726f7f58dc76b4b35989a73dd05d753f"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.548246 9678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "69e20f4db23e48aea71436d31da26d2d"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-w206"
server_key: "2dc2232beff66876cf383f23c93154a3"
server_key_iv: "726f7f58dc76b4b35989a73dd05d753f"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.551993 9678 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 05:07:36.554867 9692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.556110 9678 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:07:36.556304 9678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "69e20f4db23e48aea71436d31da26d2d"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-w206"
server_key: "2dc2232beff66876cf383f23c93154a3"
server_key_iv: "726f7f58dc76b4b35989a73dd05d753f"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.556429 9678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:36.568012 9678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:36.568674 9678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:36.568871 9678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:36.569446 9678 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:36.570364 9678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:36.570434 9678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.570515 9678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:36.570550 9678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.579671 9678 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:40441
I20260811 05:07:36.579702 9814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:40441 every 8 connection(s)
I20260811 05:07:36.580612 9678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:07:36.585655 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 9678
I20260811 05:07:36.585777 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:07:36.586125 22727 external_mini_cluster.cc:1428] Setting key 07e80901c5dc425ce5121509e31b7e89
I20260811 05:07:36.588515 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35605
--builtin_ntp_servers=127.22.49.212:44033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 05:07:36.590919 9654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.582542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:43723 (local address 127.22.49.254:35605)
0811 05:07:36.582692 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:36.582695 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:36.583735 (+ 1040us) server_negotiation.cc:407] Connection header received
0811 05:07:36.585173 (+ 1438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:36.585176 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:36.585234 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:36.585329 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:36.586402 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.587143 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.588623 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.589044 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.589182 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:36.590412 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:36.590416 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:36.590419 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:36.590433 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:36.590461 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:36.590470 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:36.590547 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:36.590708 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 05:07:36.590775 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 05:07:36.591843 9817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.582871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35605 (local address 127.22.49.193:43723)
0811 05:07:36.583585 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:36.583625 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:36.584957 (+ 1332us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:36.585491 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:36.585498 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:36.585582 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:36.586248 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:36.586264 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.587287 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.587290 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:36.588461 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:36.588473 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.589234 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.589238 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:36.589412 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:36.590115 (+ 703us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:07:36.590117 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:36.590159 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:07:36.590228 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:36.590563 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:36.590573 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:36.590583 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 05:07:36.590707 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 05:07:36.591051 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":126,"threads_started":1}
I20260811 05:07:36.593166 9815 heartbeater.cc:347] Connected to a master server at 127.22.49.254:35605
I20260811 05:07:36.593474 9815 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:36.594172 9815 heartbeater.cc:511] Master 127.22.49.254:35605 requested a full tablet report, sending...
I20260811 05:07:36.596042 9615 ts_manager.cc:194] Registered new tserver with Master: 69e20f4db23e48aea71436d31da26d2d (127.22.49.193:40441)
I20260811 05:07:36.597340 9615 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.49.193:43723
W20260811 05:07:36.704074 9818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:36.704361 9818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:36.704411 9818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:36.708364 9818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:36.708423 9818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:36.708478 9818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:07:36.713172 9818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:44033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:36.714344 9818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:36.715746 9818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:36.725855 9827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:36.725845 9825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:36.725845 9824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:36.726341 9818 server_base.cc:1034] running on GCE node
I20260811 05:07:36.726773 9818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:36.727526 9818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:36.728742 9818 hybrid_clock.cc:648] HybridClock initialized: now 1786424856728714 us; error 50 us; skew 500 ppm
I20260811 05:07:36.730710 9818 webserver.cc:460] Webserver started at http://127.22.49.194:32965/ using document root <none> and password file <none>
I20260811 05:07:36.731388 9818 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:36.731484 9818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:36.731720 9818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:36.733791 9818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "0c46d95a247c47e093937ca45a2e43f1"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-w206"
server_key: "d44ab3d1275514ac814ee6f4dabecd2a"
server_key_iv: "4c35d1efe743f0bbe0a3b4bfd5a96986"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.734407 9818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "0c46d95a247c47e093937ca45a2e43f1"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-w206"
server_key: "d44ab3d1275514ac814ee6f4dabecd2a"
server_key_iv: "4c35d1efe743f0bbe0a3b4bfd5a96986"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.738253 9818 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 05:07:36.740757 9833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.741931 9818 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260811 05:07:36.742062 9818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "0c46d95a247c47e093937ca45a2e43f1"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-w206"
server_key: "d44ab3d1275514ac814ee6f4dabecd2a"
server_key_iv: "4c35d1efe743f0bbe0a3b4bfd5a96986"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.742177 9818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:36.755089 9818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:36.755769 9818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:36.755986 9818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:36.756577 9818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:36.757531 9818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:36.757603 9818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.757671 9818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:36.757719 9818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.766772 9818 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:44007
I20260811 05:07:36.766824 9957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:44007 every 8 connection(s)
I20260811 05:07:36.767711 9818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:07:36.776762 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 9818
I20260811 05:07:36.776928 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:07:36.777223 9654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.769606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:55175 (local address 127.22.49.254:35605)
0811 05:07:36.769761 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:36.769764 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:36.770875 (+ 1111us) server_negotiation.cc:407] Connection header received
0811 05:07:36.772348 (+ 1473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:36.772351 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:36.772399 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:36.772477 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:36.773429 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.773951 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.775230 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.775447 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.775531 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:36.776691 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:36.776695 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:36.776697 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:36.776710 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:36.776730 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:36.776737 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:36.776798 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:36.777047 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 05:07:36.777105 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 05:07:36.777293 22727 external_mini_cluster.cc:1428] Setting key fe6099fb0d7f3e86ab64ccdef094e700
I20260811 05:07:36.778276 9960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.769998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35605 (local address 127.22.49.194:55175)
0811 05:07:36.770723 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:36.770769 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:36.772099 (+ 1330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:36.772640 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:36.772646 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:36.772726 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:36.773194 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:36.773205 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.774098 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.774101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:36.775104 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:36.775115 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.775592 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.775594 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:36.775734 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:36.776361 (+ 627us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:07:36.776363 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:36.776403 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:07:36.776520 (+ 117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:36.776831 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:36.776841 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:36.776850 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 05:07:36.777034 (+ 184us) client_negotiation.cc:240] Negotiation successful
0811 05:07:36.777347 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":119,"threads_started":1}
I20260811 05:07:36.779541 9958 heartbeater.cc:347] Connected to a master server at 127.22.49.254:35605
I20260811 05:07:36.779776 9958 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:36.779776 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35605
--builtin_ntp_servers=127.22.49.212:44033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 05:07:36.780369 9958 heartbeater.cc:511] Master 127.22.49.254:35605 requested a full tablet report, sending...
I20260811 05:07:36.781443 9615 ts_manager.cc:194] Registered new tserver with Master: 0c46d95a247c47e093937ca45a2e43f1 (127.22.49.194:44007)
I20260811 05:07:36.782027 9615 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.49.194:55175
W20260811 05:07:36.895962 9961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:36.896219 9961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:36.896263 9961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:36.900460 9961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:36.900527 9961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:36.900606 9961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:07:36.905467 9961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:44033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:36.906654 9961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:36.908139 9961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:36.917773 9968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:36.917924 9961 server_base.cc:1034] running on GCE node
W20260811 05:07:36.917788 9967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:36.917773 9971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:36.918560 9961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:36.919291 9961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:36.920483 9961 hybrid_clock.cc:648] HybridClock initialized: now 1786424856920454 us; error 41 us; skew 500 ppm
I20260811 05:07:36.922675 9961 webserver.cc:460] Webserver started at http://127.22.49.195:34265/ using document root <none> and password file <none>
I20260811 05:07:36.923316 9961 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:36.923413 9961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:36.923650 9961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:36.925721 9961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "b679edc39dac433d8ad2db652a3e531d"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-w206"
server_key: "17c1bca5256f0f4ccc04cba9cd1ea448"
server_key_iv: "e43c356c0241173b5dd1a1512e7ae297"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.926370 9961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "b679edc39dac433d8ad2db652a3e531d"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-w206"
server_key: "17c1bca5256f0f4ccc04cba9cd1ea448"
server_key_iv: "e43c356c0241173b5dd1a1512e7ae297"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.930193 9961 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 05:07:36.932976 9977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.934393 9961 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 05:07:36.934558 9961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "b679edc39dac433d8ad2db652a3e531d"
format_stamp: "Formatted at 2026-08-11 05:07:36 on dist-test-slave-w206"
server_key: "17c1bca5256f0f4ccc04cba9cd1ea448"
server_key_iv: "e43c356c0241173b5dd1a1512e7ae297"
server_key_version: "encryptionkey@0"
I20260811 05:07:36.934692 9961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:36.949630 9961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:36.950371 9961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:36.950590 9961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:36.951319 9961 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:36.952348 9961 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:36.952426 9961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.952508 9961 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:36.952570 9961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:36.962343 9961 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:46357
I20260811 05:07:36.962431 10099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:46357 every 8 connection(s)
I20260811 05:07:36.963369 9961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:07:36.968721 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 9961
I20260811 05:07:36.968886 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:07:36.969208 22727 external_mini_cluster.cc:1428] Setting key 3deb968f0f452566e62ee183e7348e62
I20260811 05:07:36.973877 9654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.965360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:48485 (local address 127.22.49.254:35605)
0811 05:07:36.965521 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:36.965525 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:36.966616 (+ 1091us) server_negotiation.cc:407] Connection header received
0811 05:07:36.968245 (+ 1629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:36.968248 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:36.968315 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:36.968429 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:36.969520 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.970349 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.971952 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.972182 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.972310 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:36.973443 (+ 1133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:36.973445 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:36.973447 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:36.973459 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:36.973477 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:36.973485 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:36.973547 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:36.973697 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 05:07:36.973759 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 05:07:36.974774 10102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.965773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35605 (local address 127.22.49.195:48485)
0811 05:07:36.966455 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:36.966498 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:36.968007 (+ 1509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:36.968617 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:36.968624 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:36.968709 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:36.969355 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:36.969372 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.970545 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.970549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:36.971816 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:36.971827 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.972363 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.972366 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:36.972516 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:36.973191 (+ 675us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:07:36.973192 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:36.973233 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:07:36.973298 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:36.973564 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:36.973571 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:36.973575 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:07:36.973675 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 05:07:36.973907 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":119,"threads_started":1}
I20260811 05:07:36.976025 10100 heartbeater.cc:347] Connected to a master server at 127.22.49.254:35605
I20260811 05:07:36.976287 10100 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:36.976835 10100 heartbeater.cc:511] Master 127.22.49.254:35605 requested a full tablet report, sending...
I20260811 05:07:36.977898 9615 ts_manager.cc:194] Registered new tserver with Master: b679edc39dac433d8ad2db652a3e531d (127.22.49.195:46357)
I20260811 05:07:36.978559 9615 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.49.195:48485
I20260811 05:07:36.983382 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:07:36.989660 9654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:36.985577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60876 (local address 127.22.49.254:35605)
0811 05:07:36.985759 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:36.985764 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:36.985934 (+ 170us) server_negotiation.cc:407] Connection header received
0811 05:07:36.986089 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:36.986093 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:36.986143 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:36.986267 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:36.986534 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.987126 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.987975 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:36.988199 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:36.988322 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:36.989159 (+ 837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:36.989162 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:36.989164 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:36.989176 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:36.989195 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:36.989202 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:36.989316 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:36.989447 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 05:07:36.989504 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 05:07:36.992772 9615 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60876:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:07:36.995903 9615 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:37.010545 10117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:37.005244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60960 (local address 127.22.49.194:44007)
0811 05:07:37.005720 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:37.005736 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:37.005763 (+ 27us) server_negotiation.cc:407] Connection header received
0811 05:07:37.005843 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:37.005848 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:37.006067 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:37.006225 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:37.006789 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.007593 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.009262 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.009869 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.009997 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:37.010204 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:37.010277 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 05:07:37.010372 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":124,"threads_started":1}
I20260811 05:07:37.010540 10115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:37.004798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:44007 (local address 127.0.0.1:60960)
0811 05:07:37.005097 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:37.005113 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:37.005199 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:37.006399 (+ 1200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:37.006402 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:37.006413 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:37.006616 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:37.006652 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.007705 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.007711 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:37.009132 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:37.009143 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.009998 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.010001 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:37.010109 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:37.010147 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 05:07:37.010241 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 05:07:37.010374 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":97,"thread_start_us":115,"threads_started":1}
I20260811 05:07:37.010790 10116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:37.005175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:46357 (local address 127.0.0.1:49864)
0811 05:07:37.005651 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:37.005665 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:37.005754 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:37.006365 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:37.006374 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:37.006400 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:37.006660 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:37.006667 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.008169 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.008172 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:37.009304 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:37.009315 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.010376 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.010380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:37.010480 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:37.010503 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 05:07:37.010555 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 05:07:37.010621 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"mutex_wait_us":130,"thread_start_us":96,"threads_started":1}
I20260811 05:07:37.011430 10113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:37.004390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:40441 (local address 127.0.0.1:35202)
0811 05:07:37.004814 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:37.004885 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:37.005018 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:37.006427 (+ 1409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:37.006430 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:37.006447 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:37.006688 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:37.006696 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.008130 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.008134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:37.009331 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:37.009338 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.010376 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.010380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:37.011124 (+ 744us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:37.011142 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 05:07:37.011235 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 05:07:37.011306 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":777,"thread_start_us":102,"threads_started":1}
I20260811 05:07:37.011714 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:37.004550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35202 (local address 127.22.49.193:40441)
0811 05:07:37.006028 (+ 1478us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:37.006039 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:37.006059 (+ 20us) server_negotiation.cc:407] Connection header received
0811 05:07:37.006123 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:37.006127 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:37.006276 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:37.006598 (+ 322us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:37.006824 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.007997 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.009471 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.010227 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.010426 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:37.011055 (+ 629us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:37.011268 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 05:07:37.011376 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1375,"thread_start_us":151,"threads_started":1}
I20260811 05:07:37.012243 10118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:37.005438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49864 (local address 127.22.49.195:46357)
0811 05:07:37.005901 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:37.005912 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:37.005937 (+ 25us) server_negotiation.cc:407] Connection header received
0811 05:07:37.006011 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:37.006016 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:37.006197 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:37.006353 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:37.006788 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.008027 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.009444 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.010227 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.011718 (+ 1491us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:37.011926 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:37.011981 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 05:07:37.012080 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":167,"threads_started":1}
I20260811 05:07:37.013931 9886 tablet_service.cc:1467] Processing CreateTablet for tablet 94e98e9a158a4f0d9334b14ab0cc8a04 (DEFAULT_TABLE table=test-table [id=df1c5d42c892470c8145d54d47c3cb45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:37.014341 10028 tablet_service.cc:1467] Processing CreateTablet for tablet 94e98e9a158a4f0d9334b14ab0cc8a04 (DEFAULT_TABLE table=test-table [id=df1c5d42c892470c8145d54d47c3cb45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:37.014456 9746 tablet_service.cc:1467] Processing CreateTablet for tablet 94e98e9a158a4f0d9334b14ab0cc8a04 (DEFAULT_TABLE table=test-table [id=df1c5d42c892470c8145d54d47c3cb45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:37.015158 9886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94e98e9a158a4f0d9334b14ab0cc8a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:37.015349 10028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94e98e9a158a4f0d9334b14ab0cc8a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:37.015410 9746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94e98e9a158a4f0d9334b14ab0cc8a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:37.021396 10119 tablet_bootstrap.cc:492] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d: Bootstrap starting.
I20260811 05:07:37.023278 10120 tablet_bootstrap.cc:492] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d: Bootstrap starting.
I20260811 05:07:37.024768 10119 tablet_bootstrap.cc:654] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:37.025430 10120 tablet_bootstrap.cc:654] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:37.025697 10119 log.cc:824] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:37.026281 10120 log.cc:824] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:37.026490 10121 tablet_bootstrap.cc:492] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1: Bootstrap starting.
I20260811 05:07:37.028448 10119 tablet_bootstrap.cc:492] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d: No bootstrap required, opened a new log
I20260811 05:07:37.028599 10121 tablet_bootstrap.cc:654] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:37.028692 10119 ts_tablet_manager.cc:1397] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 05:07:37.029311 10121 log.cc:824] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:37.031389 10121 tablet_bootstrap.cc:492] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1: No bootstrap required, opened a new log
I20260811 05:07:37.031389 10120 tablet_bootstrap.cc:492] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d: No bootstrap required, opened a new log
I20260811 05:07:37.031584 10121 ts_tablet_manager.cc:1397] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 05:07:37.031584 10120 ts_tablet_manager.cc:1397] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260811 05:07:37.032408 10119 raft_consensus.cc:348] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69e20f4db23e48aea71436d31da26d2d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 40441 } } peers { permanent_uuid: "b679edc39dac433d8ad2db652a3e531d" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46357 } } peers { permanent_uuid: "0c46d95a247c47e093937ca45a2e43f1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 44007 } }
I20260811 05:07:37.032660 10119 raft_consensus.cc:374] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:37.032716 10119 raft_consensus.cc:729] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b679edc39dac433d8ad2db652a3e531d, State: Initialized, Role: FOLLOWER
I20260811 05:07:37.033190 10119 consensus_queue.cc:260] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69e20f4db23e48aea71436d31da26d2d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 40441 } } peers { permanent_uuid: "b679edc39dac433d8ad2db652a3e531d" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46357 } } peers { permanent_uuid: "0c46d95a247c47e093937ca45a2e43f1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 44007 } }
I20260811 05:07:37.034271 10119 ts_tablet_manager.cc:1428] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 05:07:37.034663 10100 heartbeater.cc:503] Master 127.22.49.254:35605 was elected leader, sending a full tablet report...
I20260811 05:07:37.036070 10121 raft_consensus.cc:348] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69e20f4db23e48aea71436d31da26d2d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 40441 } } peers { permanent_uuid: "b679edc39dac433d8ad2db652a3e531d" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46357 } } peers { permanent_uuid: "0c46d95a247c47e093937ca45a2e43f1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 44007 } }
I20260811 05:07:37.036070 10120 raft_consensus.cc:348] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69e20f4db23e48aea71436d31da26d2d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 40441 } } peers { permanent_uuid: "b679edc39dac433d8ad2db652a3e531d" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46357 } } peers { permanent_uuid: "0c46d95a247c47e093937ca45a2e43f1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 44007 } }
I20260811 05:07:37.036350 10120 raft_consensus.cc:374] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:37.036350 10121 raft_consensus.cc:374] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:37.036413 10120 raft_consensus.cc:729] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69e20f4db23e48aea71436d31da26d2d, State: Initialized, Role: FOLLOWER
I20260811 05:07:37.036420 10121 raft_consensus.cc:729] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c46d95a247c47e093937ca45a2e43f1, State: Initialized, Role: FOLLOWER
I20260811 05:07:37.036878 10120 consensus_queue.cc:260] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69e20f4db23e48aea71436d31da26d2d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 40441 } } peers { permanent_uuid: "b679edc39dac433d8ad2db652a3e531d" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46357 } } peers { permanent_uuid: "0c46d95a247c47e093937ca45a2e43f1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 44007 } }
I20260811 05:07:37.036878 10121 consensus_queue.cc:260] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69e20f4db23e48aea71436d31da26d2d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 40441 } } peers { permanent_uuid: "b679edc39dac433d8ad2db652a3e531d" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46357 } } peers { permanent_uuid: "0c46d95a247c47e093937ca45a2e43f1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 44007 } }
I20260811 05:07:37.037633 9815 heartbeater.cc:503] Master 127.22.49.254:35605 was elected leader, sending a full tablet report...
I20260811 05:07:37.037915 10120 ts_tablet_manager.cc:1428] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 05:07:37.038194 9958 heartbeater.cc:503] Master 127.22.49.254:35605 was elected leader, sending a full tablet report...
I20260811 05:07:37.039723 10121 ts_tablet_manager.cc:1428] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260811 05:07:37.081825 9816 tablet.cc:2369] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:07:37.214501 10101 tablet.cc:2369] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:07:37.263022 10127 raft_consensus.cc:482] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:37.263379 10127 raft_consensus.cc:504] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69e20f4db23e48aea71436d31da26d2d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 40441 } } peers { permanent_uuid: "b679edc39dac433d8ad2db652a3e531d" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46357 } } peers { permanent_uuid: "0c46d95a247c47e093937ca45a2e43f1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 44007 } }
I20260811 05:07:37.264770 10127 leader_election.cc:288] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69e20f4db23e48aea71436d31da26d2d (127.22.49.193:40441), b679edc39dac433d8ad2db652a3e531d (127.22.49.195:46357)
W20260811 05:07:37.268996 9959 tablet.cc:2369] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:07:37.269476 9960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:37.265129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:40441 (local address 127.22.49.194:34527)
0811 05:07:37.265293 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:37.265312 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:37.265447 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:37.265837 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:37.265841 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:37.265863 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:37.266021 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:37.266031 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.267040 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.267045 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:37.268224 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:37.268236 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.268955 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.268963 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:37.269127 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:37.269165 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 05:07:37.269281 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 05:07:37.269352 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":30}
I20260811 05:07:37.269563 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:37.265196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:34527 (local address 127.22.49.193:40441)
0811 05:07:37.265380 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:37.265383 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:37.265402 (+ 19us) server_negotiation.cc:407] Connection header received
0811 05:07:37.265583 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:37.265586 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:37.265644 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:37.265763 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:37.266157 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.266860 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.268376 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.268763 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.268919 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:37.268973 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:37.269367 (+ 394us) server_negotiation.cc:299] Negotiation successful
0811 05:07:37.269444 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260811 05:07:37.270197 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:37.265499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:46357 (local address 127.22.49.194:48811)
0811 05:07:37.265904 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:37.265916 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:37.265995 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:37.266251 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:37.266254 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:37.266272 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:37.266400 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:37.266406 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.267440 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.267443 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:37.268241 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:37.268251 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.269067 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.269073 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:37.269898 (+ 825us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:37.269922 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 05:07:37.270010 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 05:07:37.270084 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":636,"thread_start_us":134,"threads_started":1}
I20260811 05:07:37.270310 10118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:37.265683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:48811 (local address 127.22.49.195:46357)
0811 05:07:37.265859 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:37.265864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:37.266000 (+ 136us) server_negotiation.cc:407] Connection header received
0811 05:07:37.266068 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:37.266074 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:37.266136 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:37.266213 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:37.266556 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.267312 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.268383 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.268880 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.269022 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:37.269090 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:37.270076 (+ 986us) server_negotiation.cc:299] Negotiation successful
0811 05:07:37.270174 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260811 05:07:37.270403 9767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e98e9a158a4f0d9334b14ab0cc8a04" candidate_uuid: "0c46d95a247c47e093937ca45a2e43f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69e20f4db23e48aea71436d31da26d2d" is_pre_election: true
I20260811 05:07:37.270826 9767 raft_consensus.cc:2454] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c46d95a247c47e093937ca45a2e43f1 in term 0.
I20260811 05:07:37.271015 10050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e98e9a158a4f0d9334b14ab0cc8a04" candidate_uuid: "0c46d95a247c47e093937ca45a2e43f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b679edc39dac433d8ad2db652a3e531d" is_pre_election: true
I20260811 05:07:37.271363 10050 raft_consensus.cc:2454] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c46d95a247c47e093937ca45a2e43f1 in term 0.
I20260811 05:07:37.271438 9836 leader_election.cc:302] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c46d95a247c47e093937ca45a2e43f1, 69e20f4db23e48aea71436d31da26d2d; no voters:
I20260811 05:07:37.271822 10127 raft_consensus.cc:2781] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:37.271900 10127 raft_consensus.cc:482] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:37.271931 10127 raft_consensus.cc:3037] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:37.272971 10127 raft_consensus.cc:504] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69e20f4db23e48aea71436d31da26d2d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 40441 } } peers { permanent_uuid: "b679edc39dac433d8ad2db652a3e531d" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46357 } } peers { permanent_uuid: "0c46d95a247c47e093937ca45a2e43f1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 44007 } }
I20260811 05:07:37.273326 10127 leader_election.cc:288] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [CANDIDATE]: Term 1 election: Requested vote from peers 69e20f4db23e48aea71436d31da26d2d (127.22.49.193:40441), b679edc39dac433d8ad2db652a3e531d (127.22.49.195:46357)
I20260811 05:07:37.273849 10050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e98e9a158a4f0d9334b14ab0cc8a04" candidate_uuid: "0c46d95a247c47e093937ca45a2e43f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b679edc39dac433d8ad2db652a3e531d"
I20260811 05:07:37.273994 10050 raft_consensus.cc:3037] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:37.275111 10050 raft_consensus.cc:2454] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c46d95a247c47e093937ca45a2e43f1 in term 1.
I20260811 05:07:37.275235 9767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e98e9a158a4f0d9334b14ab0cc8a04" candidate_uuid: "0c46d95a247c47e093937ca45a2e43f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69e20f4db23e48aea71436d31da26d2d"
I20260811 05:07:37.275400 9767 raft_consensus.cc:3037] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:37.275555 9836 leader_election.cc:302] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c46d95a247c47e093937ca45a2e43f1, b679edc39dac433d8ad2db652a3e531d; no voters:
I20260811 05:07:37.275767 10127 raft_consensus.cc:2781] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:37.276008 10127 raft_consensus.cc:686] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [term 1 LEADER]: Becoming Leader. State: Replica: 0c46d95a247c47e093937ca45a2e43f1, State: Running, Role: LEADER
I20260811 05:07:37.276526 10127 consensus_queue.cc:237] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69e20f4db23e48aea71436d31da26d2d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 40441 } } peers { permanent_uuid: "b679edc39dac433d8ad2db652a3e531d" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46357 } } peers { permanent_uuid: "0c46d95a247c47e093937ca45a2e43f1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 44007 } }
I20260811 05:07:37.276666 9767 raft_consensus.cc:2454] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c46d95a247c47e093937ca45a2e43f1 in term 1.
I20260811 05:07:37.279979 9614 catalog_manager.cc:5495] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c46d95a247c47e093937ca45a2e43f1 (127.22.49.194). New cstate: current_term: 1 leader_uuid: "0c46d95a247c47e093937ca45a2e43f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69e20f4db23e48aea71436d31da26d2d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 40441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b679edc39dac433d8ad2db652a3e531d" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c46d95a247c47e093937ca45a2e43f1" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 44007 } health_report { overall_health: HEALTHY } } }
I20260811 05:07:37.311050 10117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:37.307433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60964 (local address 127.22.49.194:44007)
0811 05:07:37.307602 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:37.307605 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:37.307617 (+ 12us) server_negotiation.cc:407] Connection header received
0811 05:07:37.307693 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:37.307695 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:37.307751 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:37.307877 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:37.308127 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.308628 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.309527 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:37.309744 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:37.309861 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:37.310173 (+ 312us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:37.310596 (+ 423us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:37.310735 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:37.310801 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 05:07:37.310855 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 05:07:37.316955 10050 raft_consensus.cc:1261] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d [term 1 FOLLOWER]: Refusing update from remote peer 0c46d95a247c47e093937ca45a2e43f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:37.316955 9767 raft_consensus.cc:1261] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d [term 1 FOLLOWER]: Refusing update from remote peer 0c46d95a247c47e093937ca45a2e43f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:37.317667 10127 consensus_queue.cc:1035] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b679edc39dac433d8ad2db652a3e531d" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:37.317909 10129 consensus_queue.cc:1035] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69e20f4db23e48aea71436d31da26d2d" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:37.326697 10133 mvcc.cc:205] Tried to move back new op lower bound from 7317196215562358784 to 7317196215407747072. Current Snapshot: MvccSnapshot[applied={T|T < 7317196215562358784}]
I20260811 05:07:37.335276 9615 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:37.335456 9615 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:37.338132 9615 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b8ebf03b8f2451798031e10710530a8: Sending DeleteTablet for 3 replicas of tablet 94e98e9a158a4f0d9334b14ab0cc8a04
I20260811 05:07:37.339174 9886 tablet_service.cc:1514] Processing DeleteTablet for tablet 94e98e9a158a4f0d9334b14ab0cc8a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:37 UTC) from {username='slave'} at 127.0.0.1:60960
I20260811 05:07:37.339282 9746 tablet_service.cc:1514] Processing DeleteTablet for tablet 94e98e9a158a4f0d9334b14ab0cc8a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:37 UTC) from {username='slave'} at 127.0.0.1:35202
I20260811 05:07:37.339772 10028 tablet_service.cc:1514] Processing DeleteTablet for tablet 94e98e9a158a4f0d9334b14ab0cc8a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:37 UTC) from {username='slave'} at 127.0.0.1:49864
I20260811 05:07:37.340444 10143 tablet_replica.cc:330] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d: stopping tablet replica
I20260811 05:07:37.340781 10143 raft_consensus.cc:2229] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:37.340996 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 9678
I20260811 05:07:37.341157 10143 raft_consensus.cc:2258] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 69e20f4db23e48aea71436d31da26d2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:37.341594 10144 tablet_replica.cc:330] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d: stopping tablet replica
I20260811 05:07:37.341905 10144 raft_consensus.cc:2229] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:37.342206 10144 raft_consensus.cc:2258] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:37.344424 10144 ts_tablet_manager.cc:1905] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:37.348579 10144 ts_tablet_manager.cc:1918] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:37.348721 10144 log.cc:1196] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/94e98e9a158a4f0d9334b14ab0cc8a04
I20260811 05:07:37.349164 10144 ts_tablet_manager.cc:1939] T 94e98e9a158a4f0d9334b14ab0cc8a04 P b679edc39dac433d8ad2db652a3e531d: Deleting consensus metadata
I20260811 05:07:37.351052 9599 catalog_manager.cc:4841] TS b679edc39dac433d8ad2db652a3e531d (127.22.49.195:46357): tablet 94e98e9a158a4f0d9334b14ab0cc8a04 (table test-table [id=df1c5d42c892470c8145d54d47c3cb45]) successfully deleted
I20260811 05:07:37.351562 10142 tablet_replica.cc:330] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1: stopping tablet replica
I20260811 05:07:37.352078 10142 raft_consensus.cc:2229] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:07:37.352737 10142 raft_consensus.cc:2258] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:37.354609 10142 ts_tablet_manager.cc:1905] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:37.357385 10142 ts_tablet_manager.cc:1918] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:37.357496 10142 log.cc:1196] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/94e98e9a158a4f0d9334b14ab0cc8a04
I20260811 05:07:37.357832 10142 ts_tablet_manager.cc:1939] T 94e98e9a158a4f0d9334b14ab0cc8a04 P 0c46d95a247c47e093937ca45a2e43f1: Deleting consensus metadata
I20260811 05:07:37.359157 9598 catalog_manager.cc:4841] TS 0c46d95a247c47e093937ca45a2e43f1 (127.22.49.194:44007): tablet 94e98e9a158a4f0d9334b14ab0cc8a04 (table test-table [id=df1c5d42c892470c8145d54d47c3cb45]) successfully deleted
W20260811 05:07:37.361137 9599 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:40441 (error 108)
I20260811 05:07:37.362049 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 9818
I20260811 05:07:37.362308 10113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:37.361941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:40441 (local address 127.0.0.1:35218)
0811 05:07:37.362109 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:37.362199 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:40441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 05:07:37.363695 9599 catalog_manager.cc:4584] TS 69e20f4db23e48aea71436d31da26d2d (127.22.49.193:40441): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 94e98e9a158a4f0d9334b14ab0cc8a04: Network error: Client connection negotiation failed: client connection to 127.22.49.193:40441: connect: Connection refused (error 111)
I20260811 05:07:37.372824 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 9961
I20260811 05:07:37.381072 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 9580
2026-08-11T05:07:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1281 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:37 dist-test-slave-w206 krb5kdc[10148](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:37 dist-test-slave-w206 krb5kdc[10148](info): set up 2 sockets
Aug 11 05:07:37 dist-test-slave-w206 krb5kdc[10148](info): commencing operation
krb5kdc: starting...
W20260811 05:07:38.482052 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:07:38 dist-test-slave-w206 krb5kdc[10148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:07:38.622437 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:45367
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:41173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:45367
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:38.736972 10161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:38.737323 10161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:38.737416 10161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:38.741562 10161 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:38.741670 10161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:38.741711 10161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:38.741775 10161 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:38.741813 10161 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:38.747272 10161 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:41173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:45367
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:45367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:38.748391 10161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:38.749466 10161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:38.758471 10171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:38.758524 10169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:38.758527 10168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:38.758574 10161 server_base.cc:1034] running on GCE node
I20260811 05:07:38.759429 10161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:38.760695 10161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:38.761866 10161 hybrid_clock.cc:648] HybridClock initialized: now 1786424858761852 us; error 29 us; skew 500 ppm
Aug 11 05:07:38 dist-test-slave-w206 krb5kdc[10148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424858, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:38.764846 10161 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:07:38.765766 10161 webserver.cc:460] Webserver started at http://127.22.49.254:34529/ using document root <none> and password file <none>
I20260811 05:07:38.766378 10161 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:38.766446 10161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:38.766693 10161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:38.768877 10161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "85383eb06ed14f94b6f8cb40ebbc0959"
format_stamp: "Formatted at 2026-08-11 05:07:38 on dist-test-slave-w206"
server_key: "f86930eba31214958d10b9bac57d3b51"
server_key_iv: "08a2d69d9f0d8199f9e78a2c70e82e20"
server_key_version: "encryptionkey@0"
I20260811 05:07:38.769460 10161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "85383eb06ed14f94b6f8cb40ebbc0959"
format_stamp: "Formatted at 2026-08-11 05:07:38 on dist-test-slave-w206"
server_key: "f86930eba31214958d10b9bac57d3b51"
server_key_iv: "08a2d69d9f0d8199f9e78a2c70e82e20"
server_key_version: "encryptionkey@0"
I20260811 05:07:38.773234 10161 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 05:07:38.775769 10178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:38.777007 10161 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:07:38.777136 10161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "85383eb06ed14f94b6f8cb40ebbc0959"
format_stamp: "Formatted at 2026-08-11 05:07:38 on dist-test-slave-w206"
server_key: "f86930eba31214958d10b9bac57d3b51"
server_key_iv: "08a2d69d9f0d8199f9e78a2c70e82e20"
server_key_version: "encryptionkey@0"
I20260811 05:07:38.777251 10161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:38.801277 10161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:38.804898 10161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:38.805106 10161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:38.813078 10161 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:45367
I20260811 05:07:38.813107 10233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:45367 every 8 connection(s)
I20260811 05:07:38.814122 10161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:38.816916 10234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:38.820713 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 10161
I20260811 05:07:38.820880 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:07:38.821157 22727 external_mini_cluster.cc:1428] Setting key d2431ac189383ebfa73a9390ef57117b
I20260811 05:07:38.822947 10234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959: Bootstrap starting.
I20260811 05:07:38.825729 10234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:38.826632 10234 log.cc:824] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:38.828894 10234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959: No bootstrap required, opened a new log
Aug 11 05:07:38 dist-test-slave-w206 krb5kdc[10148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:07:38.833467 10234 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85383eb06ed14f94b6f8cb40ebbc0959" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45367 } }
I20260811 05:07:38.833755 10234 raft_consensus.cc:374] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:38.833820 10234 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85383eb06ed14f94b6f8cb40ebbc0959, State: Initialized, Role: FOLLOWER
I20260811 05:07:38.834306 10234 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85383eb06ed14f94b6f8cb40ebbc0959" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45367 } }
I20260811 05:07:38.834475 10234 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:38.834565 10234 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:38.834666 10234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:38.835940 10234 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85383eb06ed14f94b6f8cb40ebbc0959" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45367 } }
I20260811 05:07:38.836354 10234 leader_election.cc:302] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85383eb06ed14f94b6f8cb40ebbc0959; no voters:
I20260811 05:07:38.836690 10234 leader_election.cc:288] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:38.836828 10240 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:38.837092 10240 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [term 1 LEADER]: Becoming Leader. State: Replica: 85383eb06ed14f94b6f8cb40ebbc0959, State: Running, Role: LEADER
I20260811 05:07:38.837276 10238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:38.822655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57522 (local address 127.22.49.254:45367)
0811 05:07:38.823145 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:38.823165 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:38.823208 (+ 43us) server_negotiation.cc:407] Connection header received
0811 05:07:38.824040 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:38.824062 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:38.824494 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:38.824847 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:38.825579 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:38.827144 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:38.828109 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:38.828790 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:38.828961 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:38.831795 (+ 2834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:38.831801 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:38.831821 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:38.831860 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:38.833962 (+ 2102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:38.834441 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:38.834447 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:38.834453 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:38.834635 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:38.834937 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:38.834943 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:38.834948 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:38.835470 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:38.835673 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:38.835898 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 05:07:38.836266 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":126,"threads_started":1}
I20260811 05:07:38.837484 10240 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85383eb06ed14f94b6f8cb40ebbc0959" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45367 } }
I20260811 05:07:38.837993 10234 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:38.838662 10241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85383eb06ed14f94b6f8cb40ebbc0959. Latest consensus state: current_term: 1 leader_uuid: "85383eb06ed14f94b6f8cb40ebbc0959" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85383eb06ed14f94b6f8cb40ebbc0959" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45367 } } }
I20260811 05:07:38.838905 10241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:38.839147 10243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "85383eb06ed14f94b6f8cb40ebbc0959" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85383eb06ed14f94b6f8cb40ebbc0959" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 45367 } } }
I20260811 05:07:38.839251 10243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:38.840519 10250 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:38.843197 10250 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:38.848637 10250 catalog_manager.cc:1347] Generated new cluster ID: 56cc4fdd91f64d67b95323137daf9f57
I20260811 05:07:38.848721 10250 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:38.865811 10250 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:38.866930 10250 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:38.875528 10250 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959: Generated new TSK 0
I20260811 05:07:38.876263 10250 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:07:38.908064 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45367
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:41173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:39.023681 10262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:39.023960 10262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:39.024005 10262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:39.028162 10262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:39.028234 10262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:39.028292 10262 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:07:39.033742 10262 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:41173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45367
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:39.034896 10262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:39.035955 10262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:39.046344 10267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:39.046401 10270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:39.046352 10268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:39.046692 10262 server_base.cc:1034] running on GCE node
I20260811 05:07:39.047196 10262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:39.047884 10262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:39.049099 10262 hybrid_clock.cc:648] HybridClock initialized: now 1786424859049086 us; error 26 us; skew 500 ppm
Aug 11 05:07:39 dist-test-slave-w206 krb5kdc[10148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:39.052228 10262 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:07:39.053244 10262 webserver.cc:460] Webserver started at http://127.22.49.193:40929/ using document root <none> and password file <none>
I20260811 05:07:39.053798 10262 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:39.053861 10262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:39.054033 10262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:39.056188 10262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "28ce1863c7a5466ab8b5b15ebda12a55"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-w206"
server_key: "b4f42599db409636a0a1408bda275459"
server_key_iv: "ca6e4fa9bb2d884157475d91b9b9235d"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.056864 10262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "28ce1863c7a5466ab8b5b15ebda12a55"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-w206"
server_key: "b4f42599db409636a0a1408bda275459"
server_key_iv: "ca6e4fa9bb2d884157475d91b9b9235d"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.060942 10262 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:07:39.063561 10279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.065022 10262 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:39.065176 10262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "28ce1863c7a5466ab8b5b15ebda12a55"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-w206"
server_key: "b4f42599db409636a0a1408bda275459"
server_key_iv: "ca6e4fa9bb2d884157475d91b9b9235d"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.065299 10262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:39.085693 10262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:39.089039 10262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:39.089267 10262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:39.089890 10262 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:39.090765 10262 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:39.090814 10262 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.090857 10262 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:39.090909 10262 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.100905 10262 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:46239
I20260811 05:07:39.100926 10403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:46239 every 8 connection(s)
I20260811 05:07:39.101943 10262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
Aug 11 05:07:39 dist-test-slave-w206 krb5kdc[10148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:07:39.112221 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 10262
I20260811 05:07:39.112454 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:07:39.112761 22727 external_mini_cluster.cc:1428] Setting key 9ede0fb3f16abc1c8a8b6aa1f00d7e73
I20260811 05:07:39.117478 10238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.103913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:42723 (local address 127.22.49.254:45367)
0811 05:07:39.104087 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:39.104092 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:39.104953 (+ 861us) server_negotiation.cc:407] Connection header received
0811 05:07:39.106366 (+ 1413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:39.106369 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:39.106424 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:39.106518 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:39.107828 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.108404 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.109576 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.109843 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.109944 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.112876 (+ 2932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:39.112879 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:39.112882 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:39.112908 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:39.114644 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:39.115281 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:39.115285 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:39.115289 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:39.115411 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:39.115992 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:39.115997 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:39.116000 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:39.116326 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:39.116440 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:39.117082 (+ 642us) server_negotiation.cc:299] Negotiation successful
0811 05:07:39.117242 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 05:07:39.118377 10406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.104280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:45367 (local address 127.22.49.193:42723)
0811 05:07:39.104744 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:39.104788 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:39.106144 (+ 1356us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:39.106675 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:39.106681 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:39.107127 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:39.107658 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.107671 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.108546 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.108549 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.109437 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.109447 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.110008 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.110010 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.110162 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.110875 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:39.110891 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:39.112681 (+ 1790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:39.114786 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:39.114792 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:39.114814 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:39.115163 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:39.115543 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:39.115549 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:39.115554 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:39.115810 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:39.116477 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:39.116487 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:39.116805 (+ 318us) client_negotiation.cc:769] Sending connection context
0811 05:07:39.116973 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 05:07:39.117261 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":116,"threads_started":1}
I20260811 05:07:39.119844 10404 heartbeater.cc:347] Connected to a master server at 127.22.49.254:45367
I20260811 05:07:39.120122 10404 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:39.120630 10404 heartbeater.cc:511] Master 127.22.49.254:45367 requested a full tablet report, sending...
I20260811 05:07:39.122125 10190 ts_manager.cc:194] Registered new tserver with Master: 28ce1863c7a5466ab8b5b15ebda12a55 (127.22.49.193:46239)
I20260811 05:07:39.123363 10190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:42723
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:07:39.146190 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45367
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:41173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:39.260617 10409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:39.260951 10409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:39.261030 10409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:39.265201 10409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:39.265300 10409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:39.265396 10409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:07:39.270929 10409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:41173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45367
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:39.272130 10409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:39.273169 10409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:39.282917 10415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:39.282938 10414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:39.283124 10409 server_base.cc:1034] running on GCE node
W20260811 05:07:39.283455 10418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:39.283895 10409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:39.284567 10409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:39.285760 10409 hybrid_clock.cc:648] HybridClock initialized: now 1786424859285732 us; error 70 us; skew 500 ppm
Aug 11 05:07:39 dist-test-slave-w206 krb5kdc[10148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:39.288744 10409 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:07:39.289675 10409 webserver.cc:460] Webserver started at http://127.22.49.194:35751/ using document root <none> and password file <none>
I20260811 05:07:39.290239 10409 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:39.290372 10409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:39.290602 10409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:39.292740 10409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "22ecb568236d4565a08b1890fe927ba4"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-w206"
server_key: "086a72bc399194933e7811fb930a7dff"
server_key_iv: "d9f972c019e824e72cbadb0f16e11361"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.293303 10409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "22ecb568236d4565a08b1890fe927ba4"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-w206"
server_key: "086a72bc399194933e7811fb930a7dff"
server_key_iv: "d9f972c019e824e72cbadb0f16e11361"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.297292 10409 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:07:39.299994 10427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.301247 10409 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:39.301420 10409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "22ecb568236d4565a08b1890fe927ba4"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-w206"
server_key: "086a72bc399194933e7811fb930a7dff"
server_key_iv: "d9f972c019e824e72cbadb0f16e11361"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.301539 10409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:39.343621 10409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:39.347143 10409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:39.347371 10409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:39.348004 10409 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:39.348884 10409 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:39.348958 10409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.349043 10409 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:39.349094 10409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.358654 10409 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:42043
I20260811 05:07:39.358690 10551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:42043 every 8 connection(s)
I20260811 05:07:39.359684 10409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:07:39.364562 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 10409
I20260811 05:07:39.364725 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:07:39.365029 22727 external_mini_cluster.cc:1428] Setting key 2240589613bbbeb914523bd1b92057d5
Aug 11 05:07:39 dist-test-slave-w206 krb5kdc[10148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:07:39.374584 10238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.361710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:39719 (local address 127.22.49.254:45367)
0811 05:07:39.361879 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:39.361883 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:39.362777 (+ 894us) server_negotiation.cc:407] Connection header received
0811 05:07:39.364279 (+ 1502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:39.364283 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:39.364345 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:39.364452 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:39.365880 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.366423 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.367648 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.367879 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.367994 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.370848 (+ 2854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:39.370851 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:39.370853 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:39.370877 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:39.372403 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:39.372938 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:39.372942 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:39.372943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:39.373028 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:39.373376 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:39.373380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:39.373382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:39.373578 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:39.373689 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:39.374216 (+ 527us) server_negotiation.cc:299] Negotiation successful
0811 05:07:39.374364 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
I20260811 05:07:39.375521 10554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.362137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:45367 (local address 127.22.49.194:39719)
0811 05:07:39.362615 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:39.362659 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:39.364000 (+ 1341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:39.364635 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:39.364642 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:39.365112 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:39.365725 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.365741 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.366573 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.366577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.367518 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.367528 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.368036 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.368040 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.368207 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.368892 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:39.368910 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:39.370662 (+ 1752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:39.372527 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:39.372534 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:39.372550 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:39.372827 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:39.373121 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:39.373125 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:39.373127 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:39.373271 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:39.373690 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:39.373698 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:39.373968 (+ 270us) client_negotiation.cc:769] Sending connection context
0811 05:07:39.374159 (+ 191us) client_negotiation.cc:240] Negotiation successful
0811 05:07:39.374529 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":132,"threads_started":1}
I20260811 05:07:39.376703 10552 heartbeater.cc:347] Connected to a master server at 127.22.49.254:45367
I20260811 05:07:39.377007 10552 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:39.377526 10552 heartbeater.cc:511] Master 127.22.49.254:45367 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
I20260811 05:07:39.378576 10190 ts_manager.cc:194] Registered new tserver with Master: 22ecb568236d4565a08b1890fe927ba4 (127.22.49.194:42043)
I20260811 05:07:39.379221 10190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:39719
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:07:39.395308 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45367
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:41173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:39.510587 10557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:39.510885 10557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:39.510931 10557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:39.515226 10557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:39.515314 10557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:39.515378 10557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:07:39.520994 10557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:41173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:45367
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:39.522305 10557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:39.523435 10557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:39.533788 10562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:39.533867 10565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:39.533785 10563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:39.533962 10557 server_base.cc:1034] running on GCE node
I20260811 05:07:39.534538 10557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:39.535358 10557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:39.536572 10557 hybrid_clock.cc:648] HybridClock initialized: now 1786424859536526 us; error 62 us; skew 500 ppm
Aug 11 05:07:39 dist-test-slave-w206 krb5kdc[10148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:39.540140 10557 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:07:39.541148 10557 webserver.cc:460] Webserver started at http://127.22.49.195:38847/ using document root <none> and password file <none>
I20260811 05:07:39.541752 10557 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:39.541827 10557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:39.542081 10557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:39.544528 10557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "61bec46fdf0c4bb3964cc466cce951aa"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-w206"
server_key: "7422ffab144235684bc8c76ba09049f2"
server_key_iv: "211743903a4696904fb5a6b59fa12ee4"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.545140 10557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "61bec46fdf0c4bb3964cc466cce951aa"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-w206"
server_key: "7422ffab144235684bc8c76ba09049f2"
server_key_iv: "211743903a4696904fb5a6b59fa12ee4"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.549407 10557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:07:39.552178 10572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.553711 10557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:39.553858 10557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "61bec46fdf0c4bb3964cc466cce951aa"
format_stamp: "Formatted at 2026-08-11 05:07:39 on dist-test-slave-w206"
server_key: "7422ffab144235684bc8c76ba09049f2"
server_key_iv: "211743903a4696904fb5a6b59fa12ee4"
server_key_version: "encryptionkey@0"
I20260811 05:07:39.553989 10557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:39.583556 10557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:39.587670 10557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:39.587960 10557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:39.588814 10557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:39.590276 10557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:39.590356 10557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.590436 10557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:39.590477 10557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:39.605525 10557 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:33879
I20260811 05:07:39.605542 10699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:33879 every 8 connection(s)
I20260811 05:07:39.607038 10557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:07:39.614039 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 10557
I20260811 05:07:39.614210 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:07:39.614568 22727 external_mini_cluster.cc:1428] Setting key 5e08d5813e681f4261e2ed418aba63d8
Aug 11 05:07:39 dist-test-slave-w206 krb5kdc[10148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424859, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:07:39.626730 10238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.609280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:43483 (local address 127.22.49.254:45367)
0811 05:07:39.609450 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:39.609455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:39.610588 (+ 1133us) server_negotiation.cc:407] Connection header received
0811 05:07:39.612821 (+ 2233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:39.612825 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:39.612923 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:39.613059 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:39.614707 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.615503 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.617398 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.617756 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.617890 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.621715 (+ 3825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:39.621719 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:39.621722 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:39.621760 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:39.623825 (+ 2065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:39.624659 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:39.624664 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:39.624666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:39.624781 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:39.625297 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:39.625301 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:39.625302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:39.625641 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:39.625760 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:39.626380 (+ 620us) server_negotiation.cc:299] Negotiation successful
0811 05:07:39.626543 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 05:07:39.628057 10703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.609779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:45367 (local address 127.22.49.195:43483)
0811 05:07:39.610392 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:39.610442 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:39.612492 (+ 2050us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:39.613281 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:39.613289 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:39.613683 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:39.614498 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.614521 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.615679 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.615682 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.617221 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.617234 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.618093 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.618097 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.618308 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.619263 (+ 955us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:39.619308 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:39.621447 (+ 2139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:39.623984 (+ 2537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:39.623993 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:39.624012 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:39.624523 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:39.624926 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:39.624931 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:39.624935 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:39.625181 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:39.625781 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:39.625792 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:39.626084 (+ 292us) client_negotiation.cc:769] Sending connection context
0811 05:07:39.626328 (+ 244us) client_negotiation.cc:240] Negotiation successful
0811 05:07:39.626742 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":139,"threads_started":1}
I20260811 05:07:39.629392 10701 heartbeater.cc:347] Connected to a master server at 127.22.49.254:45367
I20260811 05:07:39.629684 10701 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:39.630373 10701 heartbeater.cc:511] Master 127.22.49.254:45367 requested a full tablet report, sending...
I20260811 05:07:39.631816 10190 ts_manager.cc:194] Registered new tserver with Master: 61bec46fdf0c4bb3964cc466cce951aa (127.22.49.195:33879)
I20260811 05:07:39.632503 10190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:43483
I20260811 05:07:39.641855 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:07:39.653358 10238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.644749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57534 (local address 127.22.49.254:45367)
0811 05:07:39.644922 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:39.644928 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:39.645141 (+ 213us) server_negotiation.cc:407] Connection header received
0811 05:07:39.645218 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:39.645221 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:39.645271 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:39.645364 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:39.646166 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.646790 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.647839 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.648085 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.648173 (+ 88us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.649896 (+ 1723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:39.649899 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:39.649901 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:39.649925 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:39.651567 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:39.652079 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:39.652082 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:39.652083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:39.652158 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:39.652489 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:39.652491 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:39.652492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:39.652691 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:39.652820 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:39.653072 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 05:07:39.653175 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 05:07:39.656556 10190 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57534:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:07:39.659754 10190 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:39.675211 10717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.668544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:42043 (local address 127.0.0.1:49456)
0811 05:07:39.669614 (+ 1070us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:39.669628 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:39.669812 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:39.670529 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:39.670533 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:39.670554 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:39.670678 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.670683 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.672166 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.672170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.673522 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.673533 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.674638 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.674641 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.674716 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.674746 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 05:07:39.674905 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 05:07:39.675060 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1008,"mutex_wait_us":193,"thread_start_us":80,"threads_started":1}
I20260811 05:07:39.675218 10716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.668865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49456 (local address 127.22.49.194:42043)
0811 05:07:39.669476 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:39.669488 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:39.669717 (+ 229us) server_negotiation.cc:407] Connection header received
0811 05:07:39.670000 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:39.670006 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:39.670208 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:39.670338 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:39.670794 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.672007 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.673662 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.674515 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.674641 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.674795 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:39.674944 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 05:07:39.675071 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":136,"threads_started":1}
I20260811 05:07:39.676273 10715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.668631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49876 (local address 127.22.49.193:46239)
0811 05:07:39.669278 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:39.669286 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:39.669603 (+ 317us) server_negotiation.cc:407] Connection header received
0811 05:07:39.670002 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:39.670012 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:39.670194 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:39.670305 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:39.670873 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.672029 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.674037 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.674967 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.675106 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.675246 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:39.675999 (+ 753us) server_negotiation.cc:299] Negotiation successful
0811 05:07:39.676105 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":110,"threads_started":1}
I20260811 05:07:39.676740 10713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.668505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:46239 (local address 127.0.0.1:49876)
0811 05:07:39.669454 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:39.669507 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:39.669798 (+ 291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:39.670513 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:39.670519 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:39.670547 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:39.670695 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.670702 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.672166 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.672170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.673896 (+ 1726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.673907 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.675693 (+ 1786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.675697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.675811 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.675837 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 05:07:39.676498 (+ 661us) client_negotiation.cc:240] Negotiation successful
0811 05:07:39.676591 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"mutex_wait_us":223,"thread_start_us":137,"threads_started":1}
I20260811 05:07:39.677078 10712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.669214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:33879 (local address 127.0.0.1:45132)
0811 05:07:39.670406 (+ 1192us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:39.670419 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:39.670512 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:39.671017 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:39.671020 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:39.671040 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:39.671122 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.671128 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.672211 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.672213 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.673895 (+ 1682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.673907 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.676621 (+ 2714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.676625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.676722 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.676745 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 05:07:39.676840 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 05:07:39.676926 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1134,"mutex_wait_us":266,"thread_start_us":110,"threads_started":1}
I20260811 05:07:39.677407 10718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.669644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45132 (local address 127.22.49.195:33879)
0811 05:07:39.670266 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:39.670280 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:39.670523 (+ 243us) server_negotiation.cc:407] Connection header received
0811 05:07:39.670608 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:39.670614 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:39.670822 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:39.671115 (+ 293us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:39.671275 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.672103 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.674893 (+ 2790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.676287 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.676409 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.676556 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:39.677039 (+ 483us) server_negotiation.cc:299] Negotiation successful
0811 05:07:39.677275 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":167,"threads_started":1}
I20260811 05:07:39.678557 10479 tablet_service.cc:1467] Processing CreateTablet for tablet 7a96515210394694b090b8024adb89fa (DEFAULT_TABLE table=test-table [id=d86ad671f7014144a8a0570dc1e314c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:39.680027 10479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a96515210394694b090b8024adb89fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:39.679731 10333 tablet_service.cc:1467] Processing CreateTablet for tablet 7a96515210394694b090b8024adb89fa (DEFAULT_TABLE table=test-table [id=d86ad671f7014144a8a0570dc1e314c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:39.680328 10627 tablet_service.cc:1467] Processing CreateTablet for tablet 7a96515210394694b090b8024adb89fa (DEFAULT_TABLE table=test-table [id=d86ad671f7014144a8a0570dc1e314c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:39.680913 10333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a96515210394694b090b8024adb89fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:39.681417 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a96515210394694b090b8024adb89fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:39.686475 10719 tablet_bootstrap.cc:492] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4: Bootstrap starting.
I20260811 05:07:39.688657 10719 tablet_bootstrap.cc:654] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:39.688978 10721 tablet_bootstrap.cc:492] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa: Bootstrap starting.
I20260811 05:07:39.690011 10720 tablet_bootstrap.cc:492] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55: Bootstrap starting.
I20260811 05:07:39.690320 10719 log.cc:824] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:39.691342 10721 tablet_bootstrap.cc:654] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:39.692392 10721 log.cc:824] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:39.692399 10720 tablet_bootstrap.cc:654] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:39.692765 10719 tablet_bootstrap.cc:492] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4: No bootstrap required, opened a new log
I20260811 05:07:39.692986 10719 ts_tablet_manager.cc:1397] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260811 05:07:39.693300 10720 log.cc:824] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:39.694332 10721 tablet_bootstrap.cc:492] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa: No bootstrap required, opened a new log
I20260811 05:07:39.694531 10721 ts_tablet_manager.cc:1397] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 05:07:39.695420 10720 tablet_bootstrap.cc:492] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55: No bootstrap required, opened a new log
I20260811 05:07:39.695616 10720 ts_tablet_manager.cc:1397] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260811 05:07:39.697458 10721 raft_consensus.cc:348] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ce1863c7a5466ab8b5b15ebda12a55" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46239 } } peers { permanent_uuid: "22ecb568236d4565a08b1890fe927ba4" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 42043 } } peers { permanent_uuid: "61bec46fdf0c4bb3964cc466cce951aa" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 33879 } }
I20260811 05:07:39.697693 10721 raft_consensus.cc:374] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:39.697746 10721 raft_consensus.cc:729] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61bec46fdf0c4bb3964cc466cce951aa, State: Initialized, Role: FOLLOWER
I20260811 05:07:39.698220 10721 consensus_queue.cc:260] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ce1863c7a5466ab8b5b15ebda12a55" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46239 } } peers { permanent_uuid: "22ecb568236d4565a08b1890fe927ba4" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 42043 } } peers { permanent_uuid: "61bec46fdf0c4bb3964cc466cce951aa" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 33879 } }
I20260811 05:07:39.698467 10719 raft_consensus.cc:348] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ce1863c7a5466ab8b5b15ebda12a55" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46239 } } peers { permanent_uuid: "22ecb568236d4565a08b1890fe927ba4" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 42043 } } peers { permanent_uuid: "61bec46fdf0c4bb3964cc466cce951aa" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 33879 } }
I20260811 05:07:39.698719 10719 raft_consensus.cc:374] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:39.698776 10719 raft_consensus.cc:729] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ecb568236d4565a08b1890fe927ba4, State: Initialized, Role: FOLLOWER
I20260811 05:07:39.699182 10701 heartbeater.cc:503] Master 127.22.49.254:45367 was elected leader, sending a full tablet report...
I20260811 05:07:39.699227 10719 consensus_queue.cc:260] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ce1863c7a5466ab8b5b15ebda12a55" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46239 } } peers { permanent_uuid: "22ecb568236d4565a08b1890fe927ba4" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 42043 } } peers { permanent_uuid: "61bec46fdf0c4bb3964cc466cce951aa" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 33879 } }
I20260811 05:07:39.700271 10719 ts_tablet_manager.cc:1428] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 05:07:39.700547 10721 ts_tablet_manager.cc:1428] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260811 05:07:39.700619 10552 heartbeater.cc:503] Master 127.22.49.254:45367 was elected leader, sending a full tablet report...
I20260811 05:07:39.701649 10720 raft_consensus.cc:348] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ce1863c7a5466ab8b5b15ebda12a55" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46239 } } peers { permanent_uuid: "22ecb568236d4565a08b1890fe927ba4" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 42043 } } peers { permanent_uuid: "61bec46fdf0c4bb3964cc466cce951aa" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 33879 } }
I20260811 05:07:39.701951 10720 raft_consensus.cc:374] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:39.702021 10720 raft_consensus.cc:729] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28ce1863c7a5466ab8b5b15ebda12a55, State: Initialized, Role: FOLLOWER
I20260811 05:07:39.702448 10720 consensus_queue.cc:260] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ce1863c7a5466ab8b5b15ebda12a55" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46239 } } peers { permanent_uuid: "22ecb568236d4565a08b1890fe927ba4" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 42043 } } peers { permanent_uuid: "61bec46fdf0c4bb3964cc466cce951aa" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 33879 } }
I20260811 05:07:39.703522 10720 ts_tablet_manager.cc:1428] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260811 05:07:39.703896 10404 heartbeater.cc:503] Master 127.22.49.254:45367 was elected leader, sending a full tablet report...
I20260811 05:07:39.744854 10728 raft_consensus.cc:482] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:39.745126 10728 raft_consensus.cc:504] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ce1863c7a5466ab8b5b15ebda12a55" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46239 } } peers { permanent_uuid: "22ecb568236d4565a08b1890fe927ba4" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 42043 } } peers { permanent_uuid: "61bec46fdf0c4bb3964cc466cce951aa" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 33879 } }
I20260811 05:07:39.746785 10728 leader_election.cc:288] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ecb568236d4565a08b1890fe927ba4 (127.22.49.194:42043), 61bec46fdf0c4bb3964cc466cce951aa (127.22.49.195:33879)
I20260811 05:07:39.751201 10716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.747161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:37745 (local address 127.22.49.194:42043)
0811 05:07:39.747306 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:39.747310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:39.747579 (+ 269us) server_negotiation.cc:407] Connection header received
0811 05:07:39.747684 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:39.747688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:39.747747 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:39.747843 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:39.748223 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.748848 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.749970 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.750449 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.750553 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.750627 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:39.750932 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 05:07:39.751049 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 05:07:39.751221 10718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.747213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:41355 (local address 127.22.49.195:33879)
0811 05:07:39.747360 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:39.747365 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:39.747706 (+ 341us) server_negotiation.cc:407] Connection header received
0811 05:07:39.747864 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:39.747867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:39.747920 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:39.748001 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:39.748380 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.748880 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.750070 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.750526 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.750665 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.750761 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:39.751010 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 05:07:39.751099 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:07:39.751245 10730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.747092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:33879 (local address 127.22.49.193:41355)
0811 05:07:39.747591 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:39.747610 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:39.747736 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:39.748037 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:39.748040 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:39.748056 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:39.748202 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.748210 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.749035 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.749038 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.749920 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.749933 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.750679 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.750683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.750826 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.750845 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 05:07:39.750953 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 05:07:39.751047 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"mutex_wait_us":24,"thread_start_us":114,"threads_started":1}
I20260811 05:07:39.751403 10729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.746961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:42043 (local address 127.22.49.193:37745)
0811 05:07:39.747467 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:39.747480 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:39.747586 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:39.747863 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:39.747866 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:39.747893 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:39.748072 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.748081 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.748970 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.748976 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.749828 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:39.749837 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.750595 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.750601 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:39.750764 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.750798 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 05:07:39.750878 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 05:07:39.751005 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"mutex_wait_us":35,"thread_start_us":148,"threads_started":1}
I20260811 05:07:39.752197 10649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a96515210394694b090b8024adb89fa" candidate_uuid: "28ce1863c7a5466ab8b5b15ebda12a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61bec46fdf0c4bb3964cc466cce951aa" is_pre_election: true
I20260811 05:07:39.752221 10502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a96515210394694b090b8024adb89fa" candidate_uuid: "28ce1863c7a5466ab8b5b15ebda12a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ecb568236d4565a08b1890fe927ba4" is_pre_election: true
I20260811 05:07:39.752559 10502 raft_consensus.cc:2454] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28ce1863c7a5466ab8b5b15ebda12a55 in term 0.
I20260811 05:07:39.752559 10649 raft_consensus.cc:2454] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28ce1863c7a5466ab8b5b15ebda12a55 in term 0.
I20260811 05:07:39.753121 10281 leader_election.cc:302] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 22ecb568236d4565a08b1890fe927ba4, 28ce1863c7a5466ab8b5b15ebda12a55, 61bec46fdf0c4bb3964cc466cce951aa; no voters:
I20260811 05:07:39.753433 10728 raft_consensus.cc:2781] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:39.753537 10728 raft_consensus.cc:482] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:39.753600 10728 raft_consensus.cc:3037] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:39.755179 10728 raft_consensus.cc:504] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ce1863c7a5466ab8b5b15ebda12a55" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46239 } } peers { permanent_uuid: "22ecb568236d4565a08b1890fe927ba4" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 42043 } } peers { permanent_uuid: "61bec46fdf0c4bb3964cc466cce951aa" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 33879 } }
I20260811 05:07:39.755589 10728 leader_election.cc:288] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [CANDIDATE]: Term 1 election: Requested vote from peers 22ecb568236d4565a08b1890fe927ba4 (127.22.49.194:42043), 61bec46fdf0c4bb3964cc466cce951aa (127.22.49.195:33879)
I20260811 05:07:39.755961 10502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a96515210394694b090b8024adb89fa" candidate_uuid: "28ce1863c7a5466ab8b5b15ebda12a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ecb568236d4565a08b1890fe927ba4"
I20260811 05:07:39.756093 10649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a96515210394694b090b8024adb89fa" candidate_uuid: "28ce1863c7a5466ab8b5b15ebda12a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61bec46fdf0c4bb3964cc466cce951aa"
I20260811 05:07:39.756126 10502 raft_consensus.cc:3037] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:39.756240 10649 raft_consensus.cc:3037] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:39.757620 10502 raft_consensus.cc:2454] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28ce1863c7a5466ab8b5b15ebda12a55 in term 1.
I20260811 05:07:39.757691 10649 raft_consensus.cc:2454] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28ce1863c7a5466ab8b5b15ebda12a55 in term 1.
I20260811 05:07:39.758023 10282 leader_election.cc:302] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28ce1863c7a5466ab8b5b15ebda12a55, 61bec46fdf0c4bb3964cc466cce951aa; no voters:
I20260811 05:07:39.758261 10728 raft_consensus.cc:2781] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:39.758463 10728 raft_consensus.cc:686] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [term 1 LEADER]: Becoming Leader. State: Replica: 28ce1863c7a5466ab8b5b15ebda12a55, State: Running, Role: LEADER
I20260811 05:07:39.758837 10728 consensus_queue.cc:237] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ce1863c7a5466ab8b5b15ebda12a55" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46239 } } peers { permanent_uuid: "22ecb568236d4565a08b1890fe927ba4" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 42043 } } peers { permanent_uuid: "61bec46fdf0c4bb3964cc466cce951aa" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 33879 } }
I20260811 05:07:39.762665 10195 catalog_manager.cc:5495] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28ce1863c7a5466ab8b5b15ebda12a55 (127.22.49.193). New cstate: current_term: 1 leader_uuid: "28ce1863c7a5466ab8b5b15ebda12a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28ce1863c7a5466ab8b5b15ebda12a55" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 46239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ecb568236d4565a08b1890fe927ba4" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 42043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61bec46fdf0c4bb3964cc466cce951aa" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 33879 } health_report { overall_health: UNKNOWN } } }
I20260811 05:07:39.774245 10715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.770538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49880 (local address 127.22.49.193:46239)
0811 05:07:39.770682 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:39.770686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:39.770702 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:07:39.770884 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:39.770887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:39.770950 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:39.771107 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:39.771361 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.771885 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.772758 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:39.772999 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:39.773110 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:39.773419 (+ 309us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:39.773802 (+ 383us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:39.773968 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:39.774058 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 05:07:39.774096 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 05:07:39.780268 10649 raft_consensus.cc:1261] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa [term 1 FOLLOWER]: Refusing update from remote peer 28ce1863c7a5466ab8b5b15ebda12a55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:39.780277 10502 raft_consensus.cc:1261] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4 [term 1 FOLLOWER]: Refusing update from remote peer 28ce1863c7a5466ab8b5b15ebda12a55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:39.781049 10731 consensus_queue.cc:1035] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ecb568236d4565a08b1890fe927ba4" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:39.781440 10728 consensus_queue.cc:1035] T 7a96515210394694b090b8024adb89fa P 28ce1863c7a5466ab8b5b15ebda12a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61bec46fdf0c4bb3964cc466cce951aa" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 33879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:39.797466 10190 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:39.797626 10190 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:39.800220 10190 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 85383eb06ed14f94b6f8cb40ebbc0959: Sending DeleteTablet for 3 replicas of tablet 7a96515210394694b090b8024adb89fa
I20260811 05:07:39.801074 10333 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a96515210394694b090b8024adb89fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:39 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:49876
I20260811 05:07:39.801223 10627 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a96515210394694b090b8024adb89fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:39 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:45132
I20260811 05:07:39.801577 10479 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a96515210394694b090b8024adb89fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:39 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:49456
I20260811 05:07:39.801702 10745 tablet_replica.cc:330] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa: stopping tablet replica
I20260811 05:07:39.802080 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 10262
I20260811 05:07:39.806102 10745 raft_consensus.cc:2229] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:39.806500 10745 raft_consensus.cc:2258] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:39.808079 10745 ts_tablet_manager.cc:1905] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:39.810371 10745 ts_tablet_manager.cc:1918] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:39.810487 10745 log.cc:1196] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/7a96515210394694b090b8024adb89fa
I20260811 05:07:39.810755 10746 tablet_replica.cc:330] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4: stopping tablet replica
I20260811 05:07:39.810880 10745 ts_tablet_manager.cc:1939] T 7a96515210394694b090b8024adb89fa P 61bec46fdf0c4bb3964cc466cce951aa: Deleting consensus metadata
I20260811 05:07:39.811180 10746 raft_consensus.cc:2229] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:39.811537 10746 raft_consensus.cc:2258] T 7a96515210394694b090b8024adb89fa P 22ecb568236d4565a08b1890fe927ba4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:39.812304 10181 catalog_manager.cc:4841] TS 61bec46fdf0c4bb3964cc466cce951aa (127.22.49.195:33879): tablet 7a96515210394694b090b8024adb89fa (table test-table [id=d86ad671f7014144a8a0570dc1e314c2]) successfully deleted
I20260811 05:07:39.812647 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 10409
W20260811 05:07:39.812630 10182 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:46239 (error 108)
I20260811 05:07:39.814406 10713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.814125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:46239 (local address 127.0.0.1:49884)
0811 05:07:39.814259 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:39.814332 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:46239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 05:07:39.814581 10182 catalog_manager.cc:4584] TS 28ce1863c7a5466ab8b5b15ebda12a55 (127.22.49.193:46239): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7a96515210394694b090b8024adb89fa: Network error: Client connection negotiation failed: client connection to 127.22.49.193:46239: connect: Connection refused (error 111)
I20260811 05:07:39.822309 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 10557
I20260811 05:07:39.823565 10713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:39.822599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:42043 (local address 127.0.0.1:49472)
0811 05:07:39.823391 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:39.823462 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.194:42043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":668}
I20260811 05:07:39.829721 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 10161
2026-08-11T05:07:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2450 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T05:07:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:39Z Disabled control of system clock
I20260811 05:07:39.865556 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:36869
--webserver_interface=127.22.49.254
--webserver_port=0
--builtin_ntp_servers=127.22.49.212:33673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:36869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 05:07:39.980432 10751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:39.980720 10751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:39.980759 10751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:39.984879 10751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:39.984946 10751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:39.984962 10751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:39.984979 10751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:39.984994 10751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:39.989801 10751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:36869
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:36869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:39.990943 10751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:39.992492 10751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:40.001493 10760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:40.001482 10751 server_base.cc:1034] running on GCE node
W20260811 05:07:40.001428 10757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:40.001428 10758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:40.002480 10751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:40.003728 10751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:40.004920 10751 hybrid_clock.cc:648] HybridClock initialized: now 1786424860004891 us; error 44 us; skew 500 ppm
I20260811 05:07:40.017655 10751 webserver.cc:460] Webserver started at http://127.22.49.254:40617/ using document root <none> and password file <none>
I20260811 05:07:40.018349 10751 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:40.018502 10751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:40.018757 10751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:40.021060 10751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "00279706d8d349a98467366c459e1e69"
format_stamp: "Formatted at 2026-08-11 05:07:40 on dist-test-slave-w206"
server_key: "b3f4e3253734e20227ba8e92701d9c13"
server_key_iv: "74ec563da5f37317d96596caa11d7182"
server_key_version: "encryptionkey@0"
I20260811 05:07:40.021695 10751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "00279706d8d349a98467366c459e1e69"
format_stamp: "Formatted at 2026-08-11 05:07:40 on dist-test-slave-w206"
server_key: "b3f4e3253734e20227ba8e92701d9c13"
server_key_iv: "74ec563da5f37317d96596caa11d7182"
server_key_version: "encryptionkey@0"
I20260811 05:07:40.025748 10751 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 05:07:40.028492 10766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:40.029971 10751 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 05:07:40.030154 10751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "00279706d8d349a98467366c459e1e69"
format_stamp: "Formatted at 2026-08-11 05:07:40 on dist-test-slave-w206"
server_key: "b3f4e3253734e20227ba8e92701d9c13"
server_key_iv: "74ec563da5f37317d96596caa11d7182"
server_key_version: "encryptionkey@0"
I20260811 05:07:40.030303 10751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:40.063491 10751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:40.064339 10751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:40.064586 10751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:40.073125 10751 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:36869
I20260811 05:07:40.073139 10826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:36869 every 8 connection(s)
I20260811 05:07:40.074158 10751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:40.077442 10827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:40.083035 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 10751
I20260811 05:07:40.083189 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:07:40.083261 10827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69: Bootstrap starting.
I20260811 05:07:40.083506 22727 external_mini_cluster.cc:1428] Setting key 99dec90f1d1ec8280d90a4b85a37b639
I20260811 05:07:40.086423 10827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:40.087430 10827 log.cc:824] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:40.089314 10827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69: No bootstrap required, opened a new log
I20260811 05:07:40.092835 10827 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00279706d8d349a98467366c459e1e69" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 36869 } }
I20260811 05:07:40.093091 10827 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:40.093143 10827 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00279706d8d349a98467366c459e1e69, State: Initialized, Role: FOLLOWER
I20260811 05:07:40.093617 10827 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00279706d8d349a98467366c459e1e69" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 36869 } }
I20260811 05:07:40.093775 10827 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:40.093873 10827 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:40.093993 10827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:40.094180 10830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.085160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48174 (local address 127.22.49.254:36869)
0811 05:07:40.086194 (+ 1034us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.086218 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.086281 (+ 63us) server_negotiation.cc:407] Connection header received
0811 05:07:40.087352 (+ 1071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.087377 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.087860 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.088215 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:40.088653 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.089674 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.090611 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.091181 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.091354 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.092277 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:40.092282 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:40.092295 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:40.092683 (+ 388us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:40.092739 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:40.092759 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:40.092869 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.092988 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.093292 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":164,"threads_started":1}
I20260811 05:07:40.095240 10827 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00279706d8d349a98467366c459e1e69" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 36869 } }
I20260811 05:07:40.095578 10827 leader_election.cc:302] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00279706d8d349a98467366c459e1e69; no voters:
I20260811 05:07:40.095911 10827 leader_election.cc:288] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:40.096074 10832 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:40.096285 10832 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [term 1 LEADER]: Becoming Leader. State: Replica: 00279706d8d349a98467366c459e1e69, State: Running, Role: LEADER
I20260811 05:07:40.096603 10832 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00279706d8d349a98467366c459e1e69" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 36869 } }
I20260811 05:07:40.097224 10827 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:40.098345 10833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00279706d8d349a98467366c459e1e69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00279706d8d349a98467366c459e1e69" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 36869 } } }
I20260811 05:07:40.098474 10833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:40.098748 10834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00279706d8d349a98467366c459e1e69. Latest consensus state: current_term: 1 leader_uuid: "00279706d8d349a98467366c459e1e69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00279706d8d349a98467366c459e1e69" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 36869 } } }
I20260811 05:07:40.098870 10834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:40.098995 10843 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:40.101970 10843 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:40.107599 10843 catalog_manager.cc:1347] Generated new cluster ID: 636bacc7f54b4f308b4d332c1dbac18b
I20260811 05:07:40.107678 10843 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:40.136526 10843 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:40.137930 10843 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:40.147195 10843 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69: Generated new TSK 0
I20260811 05:07:40.148164 10843 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:07:40.164546 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:36869
--builtin_ntp_servers=127.22.49.212:33673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 05:07:40.284401 10853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:40.284667 10853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:40.284706 10853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:40.288695 10853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:40.288753 10853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:40.288807 10853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:07:40.293653 10853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:36869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:40.294747 10853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:40.296165 10853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:40.306694 10861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:40.306754 10858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:40.306705 10859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:40.307014 10853 server_base.cc:1034] running on GCE node
I20260811 05:07:40.307446 10853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:40.308118 10853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:40.309326 10853 hybrid_clock.cc:648] HybridClock initialized: now 1786424860309287 us; error 54 us; skew 500 ppm
I20260811 05:07:40.311554 10853 webserver.cc:460] Webserver started at http://127.22.49.193:46513/ using document root <none> and password file <none>
I20260811 05:07:40.312204 10853 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:40.312286 10853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:40.312469 10853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:40.314625 10853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "14b24874d7de454c9320068e2a8d3005"
format_stamp: "Formatted at 2026-08-11 05:07:40 on dist-test-slave-w206"
server_key: "f90ad3996b219669eaf0ba092f878c1c"
server_key_iv: "91a18eec93606102614d1e8042c744a0"
server_key_version: "encryptionkey@0"
I20260811 05:07:40.315289 10853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "14b24874d7de454c9320068e2a8d3005"
format_stamp: "Formatted at 2026-08-11 05:07:40 on dist-test-slave-w206"
server_key: "f90ad3996b219669eaf0ba092f878c1c"
server_key_iv: "91a18eec93606102614d1e8042c744a0"
server_key_version: "encryptionkey@0"
I20260811 05:07:40.319650 10853 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 05:07:40.322355 10868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:40.323815 10853 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:40.323917 10853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "14b24874d7de454c9320068e2a8d3005"
format_stamp: "Formatted at 2026-08-11 05:07:40 on dist-test-slave-w206"
server_key: "f90ad3996b219669eaf0ba092f878c1c"
server_key_iv: "91a18eec93606102614d1e8042c744a0"
server_key_version: "encryptionkey@0"
I20260811 05:07:40.324009 10853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:40.335182 10853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:40.335824 10853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:40.335980 10853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:40.336527 10853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:40.337422 10853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:40.337479 10853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:40.337518 10853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:40.337539 10853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:40.346832 10853 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:43459
I20260811 05:07:40.346946 10996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:43459 every 8 connection(s)
I20260811 05:07:40.347844 10853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:07:40.352607 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 10853
I20260811 05:07:40.352766 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:07:40.353091 22727 external_mini_cluster.cc:1428] Setting key d320f9b3410bbc43c0da902305ada636
I20260811 05:07:40.355278 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:36869
--builtin_ntp_servers=127.22.49.212:33673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 05:07:40.357947 10830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.349879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:41861 (local address 127.22.49.254:36869)
0811 05:07:40.350061 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.350065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.351164 (+ 1099us) server_negotiation.cc:407] Connection header received
0811 05:07:40.352608 (+ 1444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.352612 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.352674 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.352781 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:40.353910 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.354457 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.355861 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.356083 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.356193 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.357468 (+ 1275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:40.357472 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:40.357474 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:40.357488 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:40.357510 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:40.357518 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:40.357587 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.357771 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.357829 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 05:07:40.359164 11000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.350262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:36869 (local address 127.22.49.193:41861)
0811 05:07:40.350949 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:40.351056 (+ 107us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:40.352388 (+ 1332us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:40.353004 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:40.353010 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:40.353095 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:40.353759 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.353776 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.354591 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.354595 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.355696 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.355706 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.356251 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.356255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.356428 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.357114 (+ 686us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:07:40.357118 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:40.357187 (+ 69us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:07:40.357288 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:40.357610 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:40.357622 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:40.357630 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 05:07:40.357770 (+ 140us) client_negotiation.cc:240] Negotiation successful
0811 05:07:40.358117 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":122,"threads_started":1}
I20260811 05:07:40.360582 10998 heartbeater.cc:347] Connected to a master server at 127.22.49.254:36869
I20260811 05:07:40.360862 10998 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:40.361527 10998 heartbeater.cc:511] Master 127.22.49.254:36869 requested a full tablet report, sending...
I20260811 05:07:40.363224 10785 ts_manager.cc:194] Registered new tserver with Master: 14b24874d7de454c9320068e2a8d3005 (127.22.49.193:43459)
I20260811 05:07:40.364415 10785 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.49.193:41861
W20260811 05:07:40.469877 11001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:40.470214 11001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:40.470295 11001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:40.474364 11001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:40.474458 11001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:40.474550 11001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:07:40.479401 11001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:36869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:40.480578 11001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:40.481981 11001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:40.491912 11007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:40.491875 11010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:40.492056 11001 server_base.cc:1034] running on GCE node
W20260811 05:07:40.492231 11008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:40.492692 11001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:40.493399 11001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:40.494593 11001 hybrid_clock.cc:648] HybridClock initialized: now 1786424860494580 us; error 34 us; skew 500 ppm
I20260811 05:07:40.496587 11001 webserver.cc:460] Webserver started at http://127.22.49.194:37671/ using document root <none> and password file <none>
I20260811 05:07:40.497272 11001 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:40.497367 11001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:40.497620 11001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:40.500008 11001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "631188337a7f4fbc81f42112fcda6a83"
format_stamp: "Formatted at 2026-08-11 05:07:40 on dist-test-slave-w206"
server_key: "b82a22f573aca24d8a58d342882a8152"
server_key_iv: "7ee14c9ab4a4a7f0a7d9c73e72727279"
server_key_version: "encryptionkey@0"
I20260811 05:07:40.500595 11001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "631188337a7f4fbc81f42112fcda6a83"
format_stamp: "Formatted at 2026-08-11 05:07:40 on dist-test-slave-w206"
server_key: "b82a22f573aca24d8a58d342882a8152"
server_key_iv: "7ee14c9ab4a4a7f0a7d9c73e72727279"
server_key_version: "encryptionkey@0"
I20260811 05:07:40.504395 11001 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:07:40.506845 11016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:40.508129 11001 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 05:07:40.508268 11001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "631188337a7f4fbc81f42112fcda6a83"
format_stamp: "Formatted at 2026-08-11 05:07:40 on dist-test-slave-w206"
server_key: "b82a22f573aca24d8a58d342882a8152"
server_key_iv: "7ee14c9ab4a4a7f0a7d9c73e72727279"
server_key_version: "encryptionkey@0"
I20260811 05:07:40.508386 11001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:40.539244 11001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:40.540022 11001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:40.540236 11001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:40.540874 11001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:40.541873 11001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:40.541956 11001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:40.542048 11001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:40.542100 11001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:40.551194 11001 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:34227
I20260811 05:07:40.551267 11138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:34227 every 8 connection(s)
I20260811 05:07:40.552217 11001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:07:40.554821 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 11001
I20260811 05:07:40.554970 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:07:40.555353 22727 external_mini_cluster.cc:1428] Setting key 920008df59868867a072f968a200ab78
I20260811 05:07:40.557495 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:36869
--builtin_ntp_servers=127.22.49.212:33673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 05:07:40.562813 10830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.554242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:55687 (local address 127.22.49.254:36869)
0811 05:07:40.554472 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.554478 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.555714 (+ 1236us) server_negotiation.cc:407] Connection header received
0811 05:07:40.557112 (+ 1398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.557116 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.557168 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.557277 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:40.558255 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.558794 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.560612 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.560842 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.560939 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.562281 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:40.562285 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:40.562287 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:40.562301 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:40.562323 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:40.562334 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:40.562423 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.562596 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.562668 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260811 05:07:40.563738 11141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.554645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:36869 (local address 127.22.49.194:55687)
0811 05:07:40.555538 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:40.555595 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:40.556898 (+ 1303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:40.557460 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:40.557467 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:40.557550 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:40.558111 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.558124 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.558948 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.558951 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.560445 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.560459 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.561024 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.561027 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.561230 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.561983 (+ 753us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:07:40.561985 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:40.562026 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:07:40.562095 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:40.562437 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:40.562449 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:40.562462 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 05:07:40.562602 (+ 140us) client_negotiation.cc:240] Negotiation successful
0811 05:07:40.562901 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":161,"threads_started":1}
I20260811 05:07:40.565150 11139 heartbeater.cc:347] Connected to a master server at 127.22.49.254:36869
I20260811 05:07:40.565454 11139 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:40.566027 11139 heartbeater.cc:511] Master 127.22.49.254:36869 requested a full tablet report, sending...
I20260811 05:07:40.567273 10785 ts_manager.cc:194] Registered new tserver with Master: 631188337a7f4fbc81f42112fcda6a83 (127.22.49.194:34227)
I20260811 05:07:40.568176 10785 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.49.194:55687
W20260811 05:07:40.680590 11142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:40.680889 11142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:40.680930 11142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:40.685228 11142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:40.685302 11142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:40.685365 11142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:07:40.690809 11142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:36869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:40.692021 11142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:40.693394 11142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:40.703439 11150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:40.703320 11147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:40.703320 11148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:40.703577 11142 server_base.cc:1034] running on GCE node
I20260811 05:07:40.704124 11142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:40.704772 11142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:40.705950 11142 hybrid_clock.cc:648] HybridClock initialized: now 1786424860705912 us; error 56 us; skew 500 ppm
I20260811 05:07:40.708022 11142 webserver.cc:460] Webserver started at http://127.22.49.195:38865/ using document root <none> and password file <none>
I20260811 05:07:40.708617 11142 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:40.708681 11142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:40.708895 11142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:40.711131 11142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "d34a2766618d4f8ea9a19a6383f5b559"
format_stamp: "Formatted at 2026-08-11 05:07:40 on dist-test-slave-w206"
server_key: "caf428e0483639737ab9174efadae156"
server_key_iv: "d0c105d5e94c275097d8940959c3d425"
server_key_version: "encryptionkey@0"
I20260811 05:07:40.711855 11142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "d34a2766618d4f8ea9a19a6383f5b559"
format_stamp: "Formatted at 2026-08-11 05:07:40 on dist-test-slave-w206"
server_key: "caf428e0483639737ab9174efadae156"
server_key_iv: "d0c105d5e94c275097d8940959c3d425"
server_key_version: "encryptionkey@0"
I20260811 05:07:40.716126 11142 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 05:07:40.718835 11156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:40.720410 11142 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:40.720516 11142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "d34a2766618d4f8ea9a19a6383f5b559"
format_stamp: "Formatted at 2026-08-11 05:07:40 on dist-test-slave-w206"
server_key: "caf428e0483639737ab9174efadae156"
server_key_iv: "d0c105d5e94c275097d8940959c3d425"
server_key_version: "encryptionkey@0"
I20260811 05:07:40.720675 11142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:40.739917 11142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:40.740694 11142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:40.740904 11142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:40.741531 11142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:40.742534 11142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:40.742605 11142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:40.742683 11142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:40.742726 11142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:40.752218 11142 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:44851
I20260811 05:07:40.752238 11282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:44851 every 8 connection(s)
I20260811 05:07:40.753160 11142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:07:40.756403 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 11142
I20260811 05:07:40.756541 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:07:40.756881 22727 external_mini_cluster.cc:1428] Setting key e0de02ca621c135950933d64d0f0cb7c
I20260811 05:07:40.763478 10830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.755106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:47713 (local address 127.22.49.254:36869)
0811 05:07:40.755257 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.755261 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.756542 (+ 1281us) server_negotiation.cc:407] Connection header received
0811 05:07:40.758341 (+ 1799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.758344 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.758434 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.758525 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:40.759579 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.760160 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.761394 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.761625 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.761708 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.763013 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:40.763016 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:40.763018 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:40.763032 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:40.763052 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:40.763060 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:40.763118 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.763298 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.763356 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 05:07:40.764343 11285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.755536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:36869 (local address 127.22.49.195:47713)
0811 05:07:40.756272 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:40.756410 (+ 138us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:40.758118 (+ 1708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:40.758651 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:40.758658 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:40.758757 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:40.759423 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.759439 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.760309 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.760312 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.761256 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.761266 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.761798 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.761801 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.761950 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.762704 (+ 754us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:07:40.762705 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:40.762754 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:07:40.762825 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:40.763121 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:40.763127 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:40.763131 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 05:07:40.763237 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 05:07:40.763480 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":127,"threads_started":1}
I20260811 05:07:40.765575 11283 heartbeater.cc:347] Connected to a master server at 127.22.49.254:36869
I20260811 05:07:40.765866 11283 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:40.766433 11283 heartbeater.cc:511] Master 127.22.49.254:36869 requested a full tablet report, sending...
I20260811 05:07:40.767644 10785 ts_manager.cc:194] Registered new tserver with Master: d34a2766618d4f8ea9a19a6383f5b559 (127.22.49.195:44851)
I20260811 05:07:40.768240 10785 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.49.195:47713
I20260811 05:07:40.771247 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:07:40.777334 10830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.773256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48176 (local address 127.22.49.254:36869)
0811 05:07:40.773451 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.773456 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.773581 (+ 125us) server_negotiation.cc:407] Connection header received
0811 05:07:40.773742 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.773745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.773795 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.773893 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:40.774164 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.774680 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.775598 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.775835 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.775944 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.776791 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:40.776797 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:40.776805 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:40.776833 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:40.776850 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:40.776858 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:40.776992 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.777143 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.777186 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 05:07:40.780443 10785 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48176:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:07:40.783571 10785 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:40.798527 11294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.792188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:34227 (local address 127.0.0.1:44242)
0811 05:07:40.792891 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:40.792950 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:40.793089 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:40.793999 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:40.794006 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:40.794031 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:40.794174 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.794181 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.795463 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.795468 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.796764 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.796775 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.797884 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.797887 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.798015 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.798054 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 05:07:40.798208 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 05:07:40.798354 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"spinlock_wait_cycles":2816,"thread_start_us":131,"threads_started":1}
I20260811 05:07:40.798534 11296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.792331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44242 (local address 127.22.49.194:34227)
0811 05:07:40.793002 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.793015 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.793043 (+ 28us) server_negotiation.cc:407] Connection header received
0811 05:07:40.793363 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.793372 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.793635 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.793779 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:40.794311 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.795350 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.796972 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.797736 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.797871 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.798113 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.798246 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.798365 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":156,"threads_started":1}
I20260811 05:07:40.798904 11297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.792582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60990 (local address 127.22.49.195:44851)
0811 05:07:40.792976 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.792988 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.793611 (+ 623us) server_negotiation.cc:407] Connection header received
0811 05:07:40.793694 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.793700 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.793901 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.794045 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:40.794465 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.795724 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.797127 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.798053 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.798152 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.798334 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.798620 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.798738 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":96,"threads_started":1}
I20260811 05:07:40.799230 11298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.792207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:44851 (local address 127.0.0.1:60990)
0811 05:07:40.793355 (+ 1148us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:40.793370 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:40.793486 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:40.794171 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:40.794177 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:40.794195 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:40.794325 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.794332 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.795854 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.795858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.797014 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.797021 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.798403 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.798406 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.798474 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.798492 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 05:07:40.798584 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 05:07:40.799098 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1079,"mutex_wait_us":5,"thread_start_us":108,"threads_started":1}
I20260811 05:07:40.799922 11295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.792960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:43459 (local address 127.0.0.1:40088)
0811 05:07:40.793879 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:40.793893 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:40.794052 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:40.794584 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:40.794587 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:40.794605 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:40.794685 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.794690 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.796019 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.796023 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.797136 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.797147 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.799542 (+ 2395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.799548 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.799636 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.799660 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 05:07:40.799733 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 05:07:40.799802 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":856,"thread_start_us":101,"threads_started":1}
I20260811 05:07:40.800448 11300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.793263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40088 (local address 127.22.49.193:43459)
0811 05:07:40.793729 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.793743 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.793980 (+ 237us) server_negotiation.cc:407] Connection header received
0811 05:07:40.794204 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.794213 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.794417 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.794591 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:40.794789 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.795899 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.797265 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.798045 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.798152 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.798322 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.800163 (+ 1841us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.800269 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":164,"threads_started":1}
I20260811 05:07:40.801836 11066 tablet_service.cc:1467] Processing CreateTablet for tablet 65ffd45af6e34f379728f2747f3db281 (DEFAULT_TABLE table=test-table [id=e381d9ef75a948c6849be3aff7cecc0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:40.801842 11210 tablet_service.cc:1467] Processing CreateTablet for tablet 65ffd45af6e34f379728f2747f3db281 (DEFAULT_TABLE table=test-table [id=e381d9ef75a948c6849be3aff7cecc0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:40.802866 11066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65ffd45af6e34f379728f2747f3db281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:40.802867 11210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65ffd45af6e34f379728f2747f3db281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:40.806041 10922 tablet_service.cc:1467] Processing CreateTablet for tablet 65ffd45af6e34f379728f2747f3db281 (DEFAULT_TABLE table=test-table [id=e381d9ef75a948c6849be3aff7cecc0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:40.807235 10922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65ffd45af6e34f379728f2747f3db281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:40.809826 11301 tablet_bootstrap.cc:492] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83: Bootstrap starting.
I20260811 05:07:40.810935 11302 tablet_bootstrap.cc:492] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559: Bootstrap starting.
I20260811 05:07:40.812355 11301 tablet_bootstrap.cc:654] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:40.813129 11302 tablet_bootstrap.cc:654] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:40.813450 11301 log.cc:824] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:40.813948 11302 log.cc:824] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:40.815459 11304 tablet_bootstrap.cc:492] T 65ffd45af6e34f379728f2747f3db281 P 14b24874d7de454c9320068e2a8d3005: Bootstrap starting.
I20260811 05:07:40.815745 11301 tablet_bootstrap.cc:492] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83: No bootstrap required, opened a new log
I20260811 05:07:40.815869 11302 tablet_bootstrap.cc:492] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559: No bootstrap required, opened a new log
I20260811 05:07:40.815950 11301 ts_tablet_manager.cc:1397] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 05:07:40.816006 11302 ts_tablet_manager.cc:1397] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 05:07:40.817477 11304 tablet_bootstrap.cc:654] T 65ffd45af6e34f379728f2747f3db281 P 14b24874d7de454c9320068e2a8d3005: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:40.818143 11304 log.cc:824] T 65ffd45af6e34f379728f2747f3db281 P 14b24874d7de454c9320068e2a8d3005: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:40.820024 11304 tablet_bootstrap.cc:492] T 65ffd45af6e34f379728f2747f3db281 P 14b24874d7de454c9320068e2a8d3005: No bootstrap required, opened a new log
I20260811 05:07:40.820174 11304 ts_tablet_manager.cc:1397] T 65ffd45af6e34f379728f2747f3db281 P 14b24874d7de454c9320068e2a8d3005: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 05:07:40.820444 11301 raft_consensus.cc:348] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631188337a7f4fbc81f42112fcda6a83" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34227 } } peers { permanent_uuid: "d34a2766618d4f8ea9a19a6383f5b559" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 44851 } } peers { permanent_uuid: "14b24874d7de454c9320068e2a8d3005" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43459 } }
I20260811 05:07:40.820444 11302 raft_consensus.cc:348] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631188337a7f4fbc81f42112fcda6a83" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34227 } } peers { permanent_uuid: "d34a2766618d4f8ea9a19a6383f5b559" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 44851 } } peers { permanent_uuid: "14b24874d7de454c9320068e2a8d3005" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43459 } }
I20260811 05:07:40.820719 11302 raft_consensus.cc:374] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:40.820719 11301 raft_consensus.cc:374] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:40.820771 11302 raft_consensus.cc:729] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d34a2766618d4f8ea9a19a6383f5b559, State: Initialized, Role: FOLLOWER
I20260811 05:07:40.820809 11301 raft_consensus.cc:729] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631188337a7f4fbc81f42112fcda6a83, State: Initialized, Role: FOLLOWER
I20260811 05:07:40.821266 11302 consensus_queue.cc:260] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631188337a7f4fbc81f42112fcda6a83" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34227 } } peers { permanent_uuid: "d34a2766618d4f8ea9a19a6383f5b559" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 44851 } } peers { permanent_uuid: "14b24874d7de454c9320068e2a8d3005" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43459 } }
I20260811 05:07:40.821259 11301 consensus_queue.cc:260] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631188337a7f4fbc81f42112fcda6a83" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34227 } } peers { permanent_uuid: "d34a2766618d4f8ea9a19a6383f5b559" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 44851 } } peers { permanent_uuid: "14b24874d7de454c9320068e2a8d3005" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43459 } }
I20260811 05:07:40.822324 11301 ts_tablet_manager.cc:1428] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 05:07:40.822417 11302 ts_tablet_manager.cc:1428] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 05:07:40.822418 11139 heartbeater.cc:503] Master 127.22.49.254:36869 was elected leader, sending a full tablet report...
I20260811 05:07:40.822474 11283 heartbeater.cc:503] Master 127.22.49.254:36869 was elected leader, sending a full tablet report...
I20260811 05:07:40.823407 11308 raft_consensus.cc:482] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:40.823555 11308 raft_consensus.cc:504] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631188337a7f4fbc81f42112fcda6a83" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34227 } } peers { permanent_uuid: "d34a2766618d4f8ea9a19a6383f5b559" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 44851 } } peers { permanent_uuid: "14b24874d7de454c9320068e2a8d3005" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43459 } }
I20260811 05:07:40.825872 11304 raft_consensus.cc:348] T 65ffd45af6e34f379728f2747f3db281 P 14b24874d7de454c9320068e2a8d3005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631188337a7f4fbc81f42112fcda6a83" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34227 } } peers { permanent_uuid: "d34a2766618d4f8ea9a19a6383f5b559" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 44851 } } peers { permanent_uuid: "14b24874d7de454c9320068e2a8d3005" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43459 } }
I20260811 05:07:40.826160 11304 raft_consensus.cc:374] T 65ffd45af6e34f379728f2747f3db281 P 14b24874d7de454c9320068e2a8d3005 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:40.826224 11304 raft_consensus.cc:729] T 65ffd45af6e34f379728f2747f3db281 P 14b24874d7de454c9320068e2a8d3005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14b24874d7de454c9320068e2a8d3005, State: Initialized, Role: FOLLOWER
I20260811 05:07:40.826694 11304 consensus_queue.cc:260] T 65ffd45af6e34f379728f2747f3db281 P 14b24874d7de454c9320068e2a8d3005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631188337a7f4fbc81f42112fcda6a83" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34227 } } peers { permanent_uuid: "d34a2766618d4f8ea9a19a6383f5b559" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 44851 } } peers { permanent_uuid: "14b24874d7de454c9320068e2a8d3005" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43459 } }
I20260811 05:07:40.827111 11308 leader_election.cc:288] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d34a2766618d4f8ea9a19a6383f5b559 (127.22.49.195:44851), 14b24874d7de454c9320068e2a8d3005 (127.22.49.193:43459)
I20260811 05:07:40.827734 11304 ts_tablet_manager.cc:1428] T 65ffd45af6e34f379728f2747f3db281 P 14b24874d7de454c9320068e2a8d3005: Time spent starting tablet: real 0.008s user 0.004s sys 0.003s
I20260811 05:07:40.828133 10998 heartbeater.cc:503] Master 127.22.49.254:36869 was elected leader, sending a full tablet report...
I20260811 05:07:40.830407 11141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.825702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:44851 (local address 127.22.49.194:54953)
0811 05:07:40.825984 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:40.826001 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:40.826083 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:40.826664 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:40.826667 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:40.826685 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:40.826800 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.826807 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.827913 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.827917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.829138 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.829147 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.829966 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.829970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.830070 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.830092 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 05:07:40.830204 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 05:07:40.830280 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201}
I20260811 05:07:40.830775 11297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.826239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:54953 (local address 127.22.49.195:44851)
0811 05:07:40.826354 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.826359 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.826372 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:07:40.826419 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.826422 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.826467 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.826537 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:40.826968 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.827740 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.829272 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.829866 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.829972 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.830021 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.830567 (+ 546us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.830644 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 05:07:40.831359 11230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65ffd45af6e34f379728f2747f3db281" candidate_uuid: "631188337a7f4fbc81f42112fcda6a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d34a2766618d4f8ea9a19a6383f5b559" is_pre_election: true
I20260811 05:07:40.831704 11230 raft_consensus.cc:2454] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631188337a7f4fbc81f42112fcda6a83 in term 0.
I20260811 05:07:40.832377 11300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.825874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:43835 (local address 127.22.49.193:43459)
0811 05:07:40.826021 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.826028 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.828385 (+ 2357us) server_negotiation.cc:407] Connection header received
0811 05:07:40.828582 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.828586 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.828629 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.828710 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:40.828998 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.829767 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.831099 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.831585 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.831704 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.831763 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.832176 (+ 413us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.832247 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 05:07:40.832288 11017 leader_election.cc:302] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631188337a7f4fbc81f42112fcda6a83, d34a2766618d4f8ea9a19a6383f5b559; no voters:
I20260811 05:07:40.832508 11309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.825717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:43459 (local address 127.22.49.194:43835)
0811 05:07:40.828266 (+ 2549us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:40.828293 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:40.828452 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:40.828736 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:40.828739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:40.828756 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:40.828876 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.828882 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.829891 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.829897 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.830997 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:40.831008 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.831872 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.831879 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:40.832016 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.832044 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 05:07:40.832155 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 05:07:40.832225 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2485,"mutex_wait_us":326,"thread_start_us":110,"threads_started":1}
I20260811 05:07:40.833007 11308 raft_consensus.cc:2781] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:40.833114 11308 raft_consensus.cc:482] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:40.833205 11308 raft_consensus.cc:3037] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:40.833305 10946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65ffd45af6e34f379728f2747f3db281" candidate_uuid: "631188337a7f4fbc81f42112fcda6a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14b24874d7de454c9320068e2a8d3005" is_pre_election: true
I20260811 05:07:40.833590 10946 raft_consensus.cc:2454] T 65ffd45af6e34f379728f2747f3db281 P 14b24874d7de454c9320068e2a8d3005 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631188337a7f4fbc81f42112fcda6a83 in term 0.
I20260811 05:07:40.834481 11308 raft_consensus.cc:504] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631188337a7f4fbc81f42112fcda6a83" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34227 } } peers { permanent_uuid: "d34a2766618d4f8ea9a19a6383f5b559" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 44851 } } peers { permanent_uuid: "14b24874d7de454c9320068e2a8d3005" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43459 } }
I20260811 05:07:40.834828 11308 leader_election.cc:288] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [CANDIDATE]: Term 1 election: Requested vote from peers d34a2766618d4f8ea9a19a6383f5b559 (127.22.49.195:44851), 14b24874d7de454c9320068e2a8d3005 (127.22.49.193:43459)
I20260811 05:07:40.835286 10946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65ffd45af6e34f379728f2747f3db281" candidate_uuid: "631188337a7f4fbc81f42112fcda6a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14b24874d7de454c9320068e2a8d3005"
I20260811 05:07:40.835284 11230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65ffd45af6e34f379728f2747f3db281" candidate_uuid: "631188337a7f4fbc81f42112fcda6a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d34a2766618d4f8ea9a19a6383f5b559"
I20260811 05:07:40.835417 11230 raft_consensus.cc:3037] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:40.835422 10946 raft_consensus.cc:3037] T 65ffd45af6e34f379728f2747f3db281 P 14b24874d7de454c9320068e2a8d3005 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:40.836426 10946 raft_consensus.cc:2454] T 65ffd45af6e34f379728f2747f3db281 P 14b24874d7de454c9320068e2a8d3005 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631188337a7f4fbc81f42112fcda6a83 in term 1.
I20260811 05:07:40.836432 11230 raft_consensus.cc:2454] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631188337a7f4fbc81f42112fcda6a83 in term 1.
I20260811 05:07:40.836774 11020 leader_election.cc:302] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14b24874d7de454c9320068e2a8d3005, 631188337a7f4fbc81f42112fcda6a83; no voters:
I20260811 05:07:40.836943 11308 raft_consensus.cc:2781] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:40.837231 11308 raft_consensus.cc:686] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [term 1 LEADER]: Becoming Leader. State: Replica: 631188337a7f4fbc81f42112fcda6a83, State: Running, Role: LEADER
I20260811 05:07:40.837563 11308 consensus_queue.cc:237] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631188337a7f4fbc81f42112fcda6a83" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34227 } } peers { permanent_uuid: "d34a2766618d4f8ea9a19a6383f5b559" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 44851 } } peers { permanent_uuid: "14b24874d7de454c9320068e2a8d3005" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43459 } }
I20260811 05:07:40.840869 10785 catalog_manager.cc:5495] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 631188337a7f4fbc81f42112fcda6a83 (127.22.49.194). New cstate: current_term: 1 leader_uuid: "631188337a7f4fbc81f42112fcda6a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631188337a7f4fbc81f42112fcda6a83" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d34a2766618d4f8ea9a19a6383f5b559" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 44851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14b24874d7de454c9320068e2a8d3005" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43459 } health_report { overall_health: UNKNOWN } } }
W20260811 05:07:40.849036 10999 tablet.cc:2369] T 65ffd45af6e34f379728f2747f3db281 P 14b24874d7de454c9320068e2a8d3005: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:07:40.851818 11296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.847943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44246 (local address 127.22.49.194:34227)
0811 05:07:40.848071 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:40.848075 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:40.848088 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:07:40.848183 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:40.848185 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:40.848235 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:40.848321 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:40.848542 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.849035 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.850088 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:40.850320 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:40.850413 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:40.850734 (+ 321us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:40.851237 (+ 503us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:40.851374 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:40.851615 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 05:07:40.851661 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 05:07:40.857653 11230 raft_consensus.cc:1261] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559 [term 1 FOLLOWER]: Refusing update from remote peer 631188337a7f4fbc81f42112fcda6a83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:40.857653 10946 raft_consensus.cc:1261] T 65ffd45af6e34f379728f2747f3db281 P 14b24874d7de454c9320068e2a8d3005 [term 1 FOLLOWER]: Refusing update from remote peer 631188337a7f4fbc81f42112fcda6a83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:40.858462 11311 consensus_queue.cc:1035] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d34a2766618d4f8ea9a19a6383f5b559" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 44851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:40.858695 11308 consensus_queue.cc:1035] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14b24874d7de454c9320068e2a8d3005" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 43459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:40.867668 11318 mvcc.cc:205] Tried to move back new op lower bound from 7317196230065741824 to 7317196229993312256. Current Snapshot: MvccSnapshot[applied={T|T < 7317196230065741824 or (T in {7317196230065741824})}]
I20260811 05:07:40.869472 11316 mvcc.cc:205] Tried to move back new op lower bound from 7317196230065741824 to 7317196229993312256. Current Snapshot: MvccSnapshot[applied={T|T < 7317196230065741824}]
I20260811 05:07:40.873974 10784 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:40.874172 10784 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:40.876703 10784 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 00279706d8d349a98467366c459e1e69: Sending DeleteTablet for 3 replicas of tablet 65ffd45af6e34f379728f2747f3db281
I20260811 05:07:40.877584 11210 tablet_service.cc:1514] Processing DeleteTablet for tablet 65ffd45af6e34f379728f2747f3db281 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:40 UTC) from {username='slave'} at 127.0.0.1:60990
I20260811 05:07:40.877718 11066 tablet_service.cc:1514] Processing DeleteTablet for tablet 65ffd45af6e34f379728f2747f3db281 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:40 UTC) from {username='slave'} at 127.0.0.1:44242
I20260811 05:07:40.878165 11328 tablet_replica.cc:330] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83: stopping tablet replica
I20260811 05:07:40.878150 10922 tablet_service.cc:1514] Processing DeleteTablet for tablet 65ffd45af6e34f379728f2747f3db281 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:40 UTC) from {username='slave'} at 127.0.0.1:40088
I20260811 05:07:40.878175 11327 tablet_replica.cc:330] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559: stopping tablet replica
I20260811 05:07:40.878507 11328 raft_consensus.cc:2229] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:07:40.878664 11327 raft_consensus.cc:2229] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:40.878865 11328 raft_consensus.cc:2258] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:40.879055 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 10853
I20260811 05:07:40.882100 11328 ts_tablet_manager.cc:1905] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:40.882321 11327 raft_consensus.cc:2258] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:40.884012 11327 ts_tablet_manager.cc:1905] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:40.885793 11328 ts_tablet_manager.cc:1918] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:40.885902 11328 log.cc:1196] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/65ffd45af6e34f379728f2747f3db281
I20260811 05:07:40.886238 11328 ts_tablet_manager.cc:1939] T 65ffd45af6e34f379728f2747f3db281 P 631188337a7f4fbc81f42112fcda6a83: Deleting consensus metadata
I20260811 05:07:40.886965 11327 ts_tablet_manager.cc:1918] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:40.887158 11327 log.cc:1196] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/65ffd45af6e34f379728f2747f3db281
I20260811 05:07:40.887526 11327 ts_tablet_manager.cc:1939] T 65ffd45af6e34f379728f2747f3db281 P d34a2766618d4f8ea9a19a6383f5b559: Deleting consensus metadata
I20260811 05:07:40.887634 10771 catalog_manager.cc:4841] TS 631188337a7f4fbc81f42112fcda6a83 (127.22.49.194:34227): tablet 65ffd45af6e34f379728f2747f3db281 (table test-table [id=e381d9ef75a948c6849be3aff7cecc0c]) successfully deleted
I20260811 05:07:40.888914 10767 catalog_manager.cc:4841] TS d34a2766618d4f8ea9a19a6383f5b559 (127.22.49.195:44851): tablet 65ffd45af6e34f379728f2747f3db281 (table test-table [id=e381d9ef75a948c6849be3aff7cecc0c]) successfully deleted
W20260811 05:07:40.890702 10771 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:43459 (error 108)
I20260811 05:07:40.891702 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 11001
I20260811 05:07:40.891947 11294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:40.891579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:43459 (local address 127.0.0.1:40092)
0811 05:07:40.891739 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:40.891839 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:43459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 05:07:40.899338 10771 catalog_manager.cc:4584] TS 14b24874d7de454c9320068e2a8d3005 (127.22.49.193:43459): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 65ffd45af6e34f379728f2747f3db281: Network error: Client connection negotiation failed: client connection to 127.22.49.193:43459: connect: Connection refused (error 111)
I20260811 05:07:40.903920 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 11142
I20260811 05:07:40.910676 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 10751
2026-08-11T05:07:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1078 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:40 dist-test-slave-w206 krb5kdc[11334](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:40 dist-test-slave-w206 krb5kdc[11334](info): set up 2 sockets
Aug 11 05:07:40 dist-test-slave-w206 krb5kdc[11334](info): commencing operation
krb5kdc: starting...
W20260811 05:07:42.014027 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:07:42 dist-test-slave-w206 krb5kdc[11334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:07:42.147383 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:40411
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:40411
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:42.264768 11349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:42.265081 11349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:42.265164 11349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:42.269243 11349 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:42.269351 11349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:42.269389 11349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:42.269444 11349 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:42.269481 11349 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:42.274922 11349 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:40411
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:40411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:42.276074 11349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:42.277107 11349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:42.286201 11356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:42.286201 11359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:42.286230 11357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:42.286298 11349 server_base.cc:1034] running on GCE node
I20260811 05:07:42.287058 11349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:42.288129 11349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:42.289351 11349 hybrid_clock.cc:648] HybridClock initialized: now 1786424862289337 us; error 37 us; skew 500 ppm
Aug 11 05:07:42 dist-test-slave-w206 krb5kdc[11334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:42.292323 11349 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:07:42.293241 11349 webserver.cc:460] Webserver started at http://127.22.49.254:34725/ using document root <none> and password file <none>
I20260811 05:07:42.293815 11349 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:42.293905 11349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:42.294138 11349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:42.296262 11349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "e30ff1202a544bcdb933675e07c0e28b"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-w206"
server_key: "25db8b441d4171cccf9bf581412f0c7c"
server_key_iv: "bf8ab6ec7172bc4a4f07cddb8b0f7828"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.296825 11349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "e30ff1202a544bcdb933675e07c0e28b"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-w206"
server_key: "25db8b441d4171cccf9bf581412f0c7c"
server_key_iv: "bf8ab6ec7172bc4a4f07cddb8b0f7828"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.300644 11349 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:07:42.303172 11367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.304499 11349 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:42.304652 11349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "e30ff1202a544bcdb933675e07c0e28b"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-w206"
server_key: "25db8b441d4171cccf9bf581412f0c7c"
server_key_iv: "bf8ab6ec7172bc4a4f07cddb8b0f7828"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.304775 11349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:42.316103 11349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:42.319654 11349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:42.319880 11349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:42.327593 11349 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:40411
I20260811 05:07:42.327622 11423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:40411 every 8 connection(s)
I20260811 05:07:42.328585 11349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:42.331300 11424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:42.335469 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 11349
I20260811 05:07:42.335619 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:07:42.335922 22727 external_mini_cluster.cc:1428] Setting key 0ff1a16e376b5be6e5b1dfab6b052656
I20260811 05:07:42.337468 11424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b: Bootstrap starting.
I20260811 05:07:42.339907 11424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:42.340690 11424 log.cc:824] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:42.342507 11424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b: No bootstrap required, opened a new log
Aug 11 05:07:42 dist-test-slave-w206 krb5kdc[11334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:07:42.346421 11424 raft_consensus.cc:348] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e30ff1202a544bcdb933675e07c0e28b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40411 } }
I20260811 05:07:42.346868 11424 raft_consensus.cc:374] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:42.346966 11424 raft_consensus.cc:729] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e30ff1202a544bcdb933675e07c0e28b, State: Initialized, Role: FOLLOWER
I20260811 05:07:42.347563 11424 consensus_queue.cc:260] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e30ff1202a544bcdb933675e07c0e28b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40411 } }
I20260811 05:07:42.347707 11424 raft_consensus.cc:388] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:42.347820 11424 raft_consensus.cc:482] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:42.347929 11424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:42.348879 11424 raft_consensus.cc:504] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e30ff1202a544bcdb933675e07c0e28b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40411 } }
I20260811 05:07:42.349242 11424 leader_election.cc:302] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e30ff1202a544bcdb933675e07c0e28b; no voters:
I20260811 05:07:42.349642 11424 leader_election.cc:288] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:42.349773 11430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:42.350060 11430 raft_consensus.cc:686] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [term 1 LEADER]: Becoming Leader. State: Replica: e30ff1202a544bcdb933675e07c0e28b, State: Running, Role: LEADER
I20260811 05:07:42.350394 11430 consensus_queue.cc:237] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e30ff1202a544bcdb933675e07c0e28b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40411 } }
I20260811 05:07:42.351046 11424 sys_catalog.cc:564] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:42.352449 11428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.337435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55816 (local address 127.22.49.254:40411)
0811 05:07:42.337901 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.337916 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.337951 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:07:42.338691 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.338710 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.339118 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.339447 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:42.340378 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.341483 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.342377 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.342914 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.343117 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.345965 (+ 2848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:42.345970 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:42.345983 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:42.346015 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:42.348427 (+ 2412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.348949 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.348958 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.348965 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.349109 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.349477 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.349481 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.349482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.350067 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:42.350868 (+ 801us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.351050 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.351386 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":145,"threads_started":1}
I20260811 05:07:42.352398 11431 sys_catalog.cc:455] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e30ff1202a544bcdb933675e07c0e28b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e30ff1202a544bcdb933675e07c0e28b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40411 } } }
I20260811 05:07:42.352599 11431 sys_catalog.cc:458] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:42.352398 11432 sys_catalog.cc:455] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e30ff1202a544bcdb933675e07c0e28b. Latest consensus state: current_term: 1 leader_uuid: "e30ff1202a544bcdb933675e07c0e28b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e30ff1202a544bcdb933675e07c0e28b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40411 } } }
I20260811 05:07:42.352869 11432 sys_catalog.cc:458] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:42.353237 11442 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:42.356896 11442 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:42.363163 11442 catalog_manager.cc:1347] Generated new cluster ID: f8c74a9cb4f34a45b304330251f06d4b
I20260811 05:07:42.363255 11442 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:42.395704 11442 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:42.396818 11442 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:42.416529 11442 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b: Generated new TSK 0
I20260811 05:07:42.417433 11442 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.49.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
Entry for principal kudu/127.22.49.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab.
I20260811 05:07:42.456297 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40411
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:42.570621 11451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:42.570885 11451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:42.570928 11451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:42.574868 11451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:42.574925 11451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:42.574999 11451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:07:42.580160 11451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.193.keytab
--principal=kudu/127.22.49.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:42.581147 11451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:42.582089 11451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:42.591771 11460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:42.591821 11451 server_base.cc:1034] running on GCE node
W20260811 05:07:42.591739 11457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:42.591739 11458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:42.592422 11451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:42.593055 11451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:42.594211 11451 hybrid_clock.cc:648] HybridClock initialized: now 1786424862594182 us; error 48 us; skew 500 ppm
Aug 11 05:07:42 dist-test-slave-w206 krb5kdc[11334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:42.597095 11451 init.cc:377] Logged in from keytab as kudu/127.22.49.193@KRBTEST.COM (short username kudu)
I20260811 05:07:42.598016 11451 webserver.cc:460] Webserver started at http://127.22.49.193:42471/ using document root <none> and password file <none>
I20260811 05:07:42.598539 11451 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:42.598596 11451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:42.598758 11451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:42.600832 11451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "282f2556b4274c6eb395398b67a206d0"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-w206"
server_key: "a6cd5a556505c6db56da706301dc92eb"
server_key_iv: "8c7a9c813a08eb3d4f4a3353bf195205"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.601351 11451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "282f2556b4274c6eb395398b67a206d0"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-w206"
server_key: "a6cd5a556505c6db56da706301dc92eb"
server_key_iv: "8c7a9c813a08eb3d4f4a3353bf195205"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.604995 11451 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 05:07:42.607406 11467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.608794 11451 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:42.608942 11451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "282f2556b4274c6eb395398b67a206d0"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-w206"
server_key: "a6cd5a556505c6db56da706301dc92eb"
server_key_iv: "8c7a9c813a08eb3d4f4a3353bf195205"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.609058 11451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:42.626811 11451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:42.630121 11451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:42.630353 11451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:42.630962 11451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:42.631863 11451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:42.631934 11451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.632002 11451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:42.632045 11451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.641714 11451 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:34717
I20260811 05:07:42.641739 11588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:34717 every 8 connection(s)
I20260811 05:07:42.642596 11451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:07:42.643951 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 11451
I20260811 05:07:42.644096 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:07:42.644418 22727 external_mini_cluster.cc:1428] Setting key 8ce7707f4f2fecf17cf05a492bf6b8c1
Aug 11 05:07:42 dist-test-slave-w206 krb5kdc[11334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.193@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.194@KRBTEST.COM; defaulting to no policy
I20260811 05:07:42.657124 11428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.644613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:37779 (local address 127.22.49.254:40411)
0811 05:07:42.644783 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.644789 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.645730 (+ 941us) server_negotiation.cc:407] Connection header received
0811 05:07:42.647242 (+ 1512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.647245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.647300 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.647455 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:42.648602 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.649138 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.650285 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.650630 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.650743 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.653464 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:42.653468 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:42.653470 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:42.653493 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:42.654967 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.655564 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.655568 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.655570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.655653 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.656000 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.656005 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.656007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.656191 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:42.656303 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.656806 (+ 503us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.656946 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.194@KRBTEST.COM" created.
I20260811 05:07:42.658058 11591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.645082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:40411 (local address 127.22.49.193:37779)
0811 05:07:42.645582 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.645625 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.647023 (+ 1398us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.647624 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.647630 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.647983 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:42.648445 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.648458 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.649267 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.649271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.650152 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.650162 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.650777 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.650781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.650959 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.651649 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:42.651713 (+ 64us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:42.653283 (+ 1570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:42.655158 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.655164 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.655178 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.655454 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.655747 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.655751 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.655753 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.655901 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.656303 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:42.656311 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:42.656572 (+ 261us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.656763 (+ 191us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.657092 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":156,"threads_started":1}
I20260811 05:07:42.659476 11589 heartbeater.cc:347] Connected to a master server at 127.22.49.254:40411
I20260811 05:07:42.659719 11589 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:42.660260 11589 heartbeater.cc:511] Master 127.22.49.254:40411 requested a full tablet report, sending...
I20260811 05:07:42.661991 11386 ts_manager.cc:194] Registered new tserver with Master: 282f2556b4274c6eb395398b67a206d0 (127.22.49.193:34717)
I20260811 05:07:42.663800 11386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.193@KRBTEST.COM'} at 127.22.49.193:37779
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
Entry for principal kudu/127.22.49.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab.
I20260811 05:07:42.674590 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40411
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:42.788375 11595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:42.788619 11595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:42.788663 11595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:42.792722 11595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:42.792783 11595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:42.792842 11595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:07:42.798147 11595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.194.keytab
--principal=kudu/127.22.49.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:42.799244 11595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:42.800246 11595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:42.810182 11603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:42.810204 11600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:42.810245 11595 server_base.cc:1034] running on GCE node
W20260811 05:07:42.810182 11601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:42.810909 11595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:42.811600 11595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:42.812762 11595 hybrid_clock.cc:648] HybridClock initialized: now 1786424862812733 us; error 42 us; skew 500 ppm
Aug 11 05:07:42 dist-test-slave-w206 krb5kdc[11334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:42.815726 11595 init.cc:377] Logged in from keytab as kudu/127.22.49.194@KRBTEST.COM (short username kudu)
I20260811 05:07:42.816557 11595 webserver.cc:460] Webserver started at http://127.22.49.194:41375/ using document root <none> and password file <none>
I20260811 05:07:42.817113 11595 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:42.817178 11595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:42.817343 11595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:42.819442 11595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "54b39976fc38414287d1e269fe95bb94"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-w206"
server_key: "6a6965d770dd3663fb6e7583adab0843"
server_key_iv: "a19366ea552cc6524bc84e00b395e9ad"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.819988 11595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "54b39976fc38414287d1e269fe95bb94"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-w206"
server_key: "6a6965d770dd3663fb6e7583adab0843"
server_key_iv: "a19366ea552cc6524bc84e00b395e9ad"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.823824 11595 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 05:07:42.826223 11613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.827551 11595 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:07:42.827652 11595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "54b39976fc38414287d1e269fe95bb94"
format_stamp: "Formatted at 2026-08-11 05:07:42 on dist-test-slave-w206"
server_key: "6a6965d770dd3663fb6e7583adab0843"
server_key_iv: "a19366ea552cc6524bc84e00b395e9ad"
server_key_version: "encryptionkey@0"
I20260811 05:07:42.827739 11595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:42.844461 11595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:42.847800 11595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:42.847956 11595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:42.848486 11595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:42.849254 11595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:42.849299 11595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.849339 11595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:42.849354 11595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:42.858525 11595 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:35247
I20260811 05:07:42.858601 11732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:35247 every 8 connection(s)
I20260811 05:07:42.859491 11595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:07:42.861830 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 11595
I20260811 05:07:42.861976 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:07:42.862251 22727 external_mini_cluster.cc:1428] Setting key 40434ffd5af71c49d1445fa987812269
Aug 11 05:07:42 dist-test-slave-w206 krb5kdc[11334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424862, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.194@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.195@KRBTEST.COM; defaulting to no policy
I20260811 05:07:42.874181 11428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.861320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:51307 (local address 127.22.49.254:40411)
0811 05:07:42.861465 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:42.861469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:42.862802 (+ 1333us) server_negotiation.cc:407] Connection header received
0811 05:07:42.863981 (+ 1179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:42.863984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:42.864037 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:42.864121 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:42.865279 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.865889 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.867135 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.867533 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.867660 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.870384 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:42.870390 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:42.870397 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:42.870432 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:42.872141 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.872657 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.872663 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.872665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.872759 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:42.873096 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:42.873099 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:42.873101 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:42.873336 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:42.873463 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:42.873953 (+ 490us) server_negotiation.cc:299] Negotiation successful
0811 05:07:42.874056 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 05:07:42.875130 11735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:42.861650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:40411 (local address 127.22.49.194:51307)
0811 05:07:42.862631 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:42.862689 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:42.863757 (+ 1068us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:42.864301 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:42.864308 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:42.864672 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:42.865136 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.865150 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.866031 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.866034 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.866957 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:42.866967 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:42.867687 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:42.867690 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:42.867832 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:42.868457 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:42.868473 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:42.870197 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:42.872277 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.872283 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.872297 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.872548 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.872867 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:42.872869 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:42.872870 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:42.873001 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:42.873473 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:42.873478 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:42.873706 (+ 228us) client_negotiation.cc:769] Sending connection context
0811 05:07:42.873882 (+ 176us) client_negotiation.cc:240] Negotiation successful
0811 05:07:42.874134 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":765,"thread_start_us":606,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.195@KRBTEST.COM" created.
I20260811 05:07:42.876454 11733 heartbeater.cc:347] Connected to a master server at 127.22.49.254:40411
I20260811 05:07:42.876703 11733 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:42.877228 11733 heartbeater.cc:511] Master 127.22.49.254:40411 requested a full tablet report, sending...
I20260811 05:07:42.878311 11386 ts_manager.cc:194] Registered new tserver with Master: 54b39976fc38414287d1e269fe95bb94 (127.22.49.194:35247)
I20260811 05:07:42.878968 11386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.194@KRBTEST.COM'} at 127.22.49.194:51307
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
Entry for principal kudu/127.22.49.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab.
I20260811 05:07:42.894459 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40411
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:43.013936 11738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:43.014206 11738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:43.014258 11738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:43.018318 11738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:43.018386 11738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:43.018486 11738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:07:43.023941 11738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.195.keytab
--principal=kudu/127.22.49.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:40411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:43.024994 11738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:43.026017 11738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:43.035645 11743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:43.035645 11746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:43.035645 11744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:43.035995 11738 server_base.cc:1034] running on GCE node
I20260811 05:07:43.036408 11738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:43.037115 11738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:43.038321 11738 hybrid_clock.cc:648] HybridClock initialized: now 1786424863038307 us; error 31 us; skew 500 ppm
Aug 11 05:07:43 dist-test-slave-w206 krb5kdc[11334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424863, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:43.041488 11738 init.cc:377] Logged in from keytab as kudu/127.22.49.195@KRBTEST.COM (short username kudu)
I20260811 05:07:43.042351 11738 webserver.cc:460] Webserver started at http://127.22.49.195:42821/ using document root <none> and password file <none>
I20260811 05:07:43.042910 11738 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:43.043026 11738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:43.043226 11738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:43.045399 11738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "39c243e9f13549de9baa4c12bec78fbe"
format_stamp: "Formatted at 2026-08-11 05:07:43 on dist-test-slave-w206"
server_key: "4a7a50b669e30a07763d71b5e754b8e2"
server_key_iv: "5865710ba51cc8063158d3c3d599e043"
server_key_version: "encryptionkey@0"
I20260811 05:07:43.045985 11738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "39c243e9f13549de9baa4c12bec78fbe"
format_stamp: "Formatted at 2026-08-11 05:07:43 on dist-test-slave-w206"
server_key: "4a7a50b669e30a07763d71b5e754b8e2"
server_key_iv: "5865710ba51cc8063158d3c3d599e043"
server_key_version: "encryptionkey@0"
I20260811 05:07:43.050092 11738 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260811 05:07:43.053313 11754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:43.054641 11738 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:07:43.054740 11738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "39c243e9f13549de9baa4c12bec78fbe"
format_stamp: "Formatted at 2026-08-11 05:07:43 on dist-test-slave-w206"
server_key: "4a7a50b669e30a07763d71b5e754b8e2"
server_key_iv: "5865710ba51cc8063158d3c3d599e043"
server_key_version: "encryptionkey@0"
I20260811 05:07:43.054834 11738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:43.090184 11738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:43.093959 11738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:43.094138 11738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:43.094835 11738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:43.095816 11738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:43.095870 11738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:43.095914 11738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:43.095942 11738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:43.106537 11738 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:46521
I20260811 05:07:43.106559 11880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:46521 every 8 connection(s)
I20260811 05:07:43.107563 11738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:07:43.112618 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 11738
I20260811 05:07:43.112773 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:07:43.113144 22727 external_mini_cluster.cc:1428] Setting key 60507a9c43c9202d5c175b9fcd7e92c8
Aug 11 05:07:43 dist-test-slave-w206 krb5kdc[11334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424863, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.195@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:07:43.122793 11428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.109445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:34955 (local address 127.22.49.254:40411)
0811 05:07:43.109603 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:43.109608 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:43.110534 (+ 926us) server_negotiation.cc:407] Connection header received
0811 05:07:43.111960 (+ 1426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:43.111963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:43.112022 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:43.112104 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:43.113655 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.114265 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.115814 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.116028 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.116112 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.118697 (+ 2585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:43.118701 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:43.118704 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:43.118729 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:43.120414 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:43.121023 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:43.121029 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:43.121031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:43.121132 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:43.121537 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:43.121542 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:43.121544 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:43.121753 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:43.121878 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:43.122450 (+ 572us) server_negotiation.cc:299] Negotiation successful
0811 05:07:43.122595 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 05:07:43.123786 11883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.109830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:40411 (local address 127.22.49.195:34955)
0811 05:07:43.110387 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:43.110433 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:43.111746 (+ 1313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:43.112266 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:43.112273 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:43.112804 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:43.113508 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.113525 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.114399 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.114401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.115691 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.115701 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.116156 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.116159 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.116348 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.116993 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:07:43.117009 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:43.118533 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:43.120572 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:43.120579 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:43.120601 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:43.120903 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:43.121260 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:07:43.121264 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:07:43.121266 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:07:43.121431 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:07:43.121877 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:43.121884 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:43.122153 (+ 269us) client_negotiation.cc:769] Sending connection context
0811 05:07:43.122382 (+ 229us) client_negotiation.cc:240] Negotiation successful
0811 05:07:43.122748 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":126,"threads_started":1}
I20260811 05:07:43.124992 11881 heartbeater.cc:347] Connected to a master server at 127.22.49.254:40411
I20260811 05:07:43.125414 11881 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:43.126039 11881 heartbeater.cc:511] Master 127.22.49.254:40411 requested a full tablet report, sending...
I20260811 05:07:43.127198 11386 ts_manager.cc:194] Registered new tserver with Master: 39c243e9f13549de9baa4c12bec78fbe (127.22.49.195:46521)
I20260811 05:07:43.127852 11386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.49.195@KRBTEST.COM'} at 127.22.49.195:34955
I20260811 05:07:43.139804 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:07:43.150229 11428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.142251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55832 (local address 127.22.49.254:40411)
0811 05:07:43.142462 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:43.142470 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:43.142540 (+ 70us) server_negotiation.cc:407] Connection header received
0811 05:07:43.142660 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:43.142662 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:43.142707 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:43.142780 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:43.143734 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.144278 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.145141 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.145375 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.145489 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.146944 (+ 1455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:43.146947 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:43.146950 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:43.146999 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:43.148493 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:43.148923 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:43.148927 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:43.148929 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:43.149016 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:43.149298 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:43.149302 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:43.149304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:43.149538 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:43.149683 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:43.149927 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 05:07:43.150054 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260811 05:07:43.153767 11386 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55832:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:07:43.156975 11386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:43.173040 11893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.166699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:34717 (local address 127.0.0.1:60278)
0811 05:07:43.167785 (+ 1086us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:43.167841 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:43.167989 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:43.168707 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:43.168710 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:43.168750 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:43.168951 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.168958 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.170389 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.170392 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.171568 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.171577 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.172431 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.172434 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.172541 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.172578 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 05:07:43.172731 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 05:07:43.172860 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":911,"mutex_wait_us":74,"spinlock_wait_cycles":5632,"thread_start_us":128,"threads_started":1}
I20260811 05:07:43.173097 11896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.167450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:35247 (local address 127.0.0.1:53514)
0811 05:07:43.167798 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:43.167841 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:43.167969 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:43.168689 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:43.168697 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:43.168722 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:43.168997 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.169007 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.170469 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.170472 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.171615 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.171625 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.172741 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.172745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.172825 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.172845 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 05:07:43.172924 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 05:07:43.172980 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"mutex_wait_us":60,"spinlock_wait_cycles":40320,"thread_start_us":97,"threads_started":1}
I20260811 05:07:43.173321 11895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.167008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59914 (local address 127.22.49.195:46521)
0811 05:07:43.167424 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:43.167438 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:43.167950 (+ 512us) server_negotiation.cc:407] Connection header received
0811 05:07:43.168186 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:43.168192 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:43.168392 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:43.168527 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:43.169177 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.169921 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.171601 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.172463 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.172573 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.172733 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:43.173061 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 05:07:43.173154 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":129,"threads_started":1}
I20260811 05:07:43.173689 11892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.166748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:46521 (local address 127.0.0.1:59914)
0811 05:07:43.167785 (+ 1037us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:43.167841 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:43.168032 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:43.168731 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:43.168734 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:43.168767 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:43.169021 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.169028 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.170060 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.170064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.171470 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.171481 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.172808 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.172812 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.172909 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.172932 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 05:07:43.173466 (+ 534us) client_negotiation.cc:240] Negotiation successful
0811 05:07:43.173564 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":913,"mutex_wait_us":117,"spinlock_wait_cycles":28288,"thread_start_us":119,"threads_started":1}
I20260811 05:07:43.173702 11894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.166812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60278 (local address 127.22.49.193:34717)
0811 05:07:43.167536 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:43.167545 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:43.167930 (+ 385us) server_negotiation.cc:407] Connection header received
0811 05:07:43.168164 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:43.168171 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:43.168383 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:43.168507 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:43.169075 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.170264 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.171692 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.172294 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.172423 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.172587 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:43.172933 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 05:07:43.173059 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":90,"threads_started":1}
I20260811 05:07:43.173718 11898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.167693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53514 (local address 127.22.49.194:35247)
0811 05:07:43.168264 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:43.168275 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:43.168296 (+ 21us) server_negotiation.cc:407] Connection header received
0811 05:07:43.168362 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:43.168366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:43.168524 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:43.168662 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:43.169124 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.170315 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.171756 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.172571 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.172707 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.172833 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:43.173504 (+ 671us) server_negotiation.cc:299] Negotiation successful
0811 05:07:43.173613 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":121,"threads_started":1}
I20260811 05:07:43.176476 11520 tablet_service.cc:1467] Processing CreateTablet for tablet 8ddff9e2542f406a96ab44f7638da699 (DEFAULT_TABLE table=test-table [id=80efad8bc51e4ad4b7da5f1ac32d0653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:43.176590 11810 tablet_service.cc:1467] Processing CreateTablet for tablet 8ddff9e2542f406a96ab44f7638da699 (DEFAULT_TABLE table=test-table [id=80efad8bc51e4ad4b7da5f1ac32d0653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:43.176591 11663 tablet_service.cc:1467] Processing CreateTablet for tablet 8ddff9e2542f406a96ab44f7638da699 (DEFAULT_TABLE table=test-table [id=80efad8bc51e4ad4b7da5f1ac32d0653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:43.177598 11520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ddff9e2542f406a96ab44f7638da699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:43.177636 11663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ddff9e2542f406a96ab44f7638da699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:43.177636 11810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ddff9e2542f406a96ab44f7638da699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:43.183995 11899 tablet_bootstrap.cc:492] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0: Bootstrap starting.
I20260811 05:07:43.185484 11900 tablet_bootstrap.cc:492] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94: Bootstrap starting.
I20260811 05:07:43.185590 11901 tablet_bootstrap.cc:492] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe: Bootstrap starting.
I20260811 05:07:43.186493 11899 tablet_bootstrap.cc:654] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:43.187427 11901 tablet_bootstrap.cc:654] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:43.187453 11899 log.cc:824] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:43.187680 11900 tablet_bootstrap.cc:654] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:43.188776 11901 log.cc:824] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:43.188943 11900 log.cc:824] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:43.190060 11899 tablet_bootstrap.cc:492] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0: No bootstrap required, opened a new log
I20260811 05:07:43.190277 11899 ts_tablet_manager.cc:1397] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 05:07:43.190771 11900 tablet_bootstrap.cc:492] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94: No bootstrap required, opened a new log
I20260811 05:07:43.190775 11901 tablet_bootstrap.cc:492] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe: No bootstrap required, opened a new log
I20260811 05:07:43.190958 11901 ts_tablet_manager.cc:1397] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 05:07:43.190958 11900 ts_tablet_manager.cc:1397] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 05:07:43.193758 11899 raft_consensus.cc:348] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282f2556b4274c6eb395398b67a206d0" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 34717 } } peers { permanent_uuid: "39c243e9f13549de9baa4c12bec78fbe" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46521 } } peers { permanent_uuid: "54b39976fc38414287d1e269fe95bb94" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35247 } }
I20260811 05:07:43.194026 11899 raft_consensus.cc:374] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:43.194082 11899 raft_consensus.cc:729] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 282f2556b4274c6eb395398b67a206d0, State: Initialized, Role: FOLLOWER
I20260811 05:07:43.194521 11899 consensus_queue.cc:260] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282f2556b4274c6eb395398b67a206d0" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 34717 } } peers { permanent_uuid: "39c243e9f13549de9baa4c12bec78fbe" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46521 } } peers { permanent_uuid: "54b39976fc38414287d1e269fe95bb94" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35247 } }
I20260811 05:07:43.194782 11901 raft_consensus.cc:348] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282f2556b4274c6eb395398b67a206d0" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 34717 } } peers { permanent_uuid: "39c243e9f13549de9baa4c12bec78fbe" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46521 } } peers { permanent_uuid: "54b39976fc38414287d1e269fe95bb94" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35247 } }
I20260811 05:07:43.194782 11900 raft_consensus.cc:348] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282f2556b4274c6eb395398b67a206d0" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 34717 } } peers { permanent_uuid: "39c243e9f13549de9baa4c12bec78fbe" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46521 } } peers { permanent_uuid: "54b39976fc38414287d1e269fe95bb94" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35247 } }
I20260811 05:07:43.195051 11901 raft_consensus.cc:374] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:43.195051 11900 raft_consensus.cc:374] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:43.195111 11901 raft_consensus.cc:729] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39c243e9f13549de9baa4c12bec78fbe, State: Initialized, Role: FOLLOWER
I20260811 05:07:43.195341 11589 heartbeater.cc:503] Master 127.22.49.254:40411 was elected leader, sending a full tablet report...
I20260811 05:07:43.195595 11899 ts_tablet_manager.cc:1428] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 05:07:43.195569 11901 consensus_queue.cc:260] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282f2556b4274c6eb395398b67a206d0" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 34717 } } peers { permanent_uuid: "39c243e9f13549de9baa4c12bec78fbe" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46521 } } peers { permanent_uuid: "54b39976fc38414287d1e269fe95bb94" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35247 } }
I20260811 05:07:43.195111 11900 raft_consensus.cc:729] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54b39976fc38414287d1e269fe95bb94, State: Initialized, Role: FOLLOWER
I20260811 05:07:43.196280 11900 consensus_queue.cc:260] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282f2556b4274c6eb395398b67a206d0" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 34717 } } peers { permanent_uuid: "39c243e9f13549de9baa4c12bec78fbe" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46521 } } peers { permanent_uuid: "54b39976fc38414287d1e269fe95bb94" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35247 } }
I20260811 05:07:43.196480 11901 ts_tablet_manager.cc:1428] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260811 05:07:43.196537 11881 heartbeater.cc:503] Master 127.22.49.254:40411 was elected leader, sending a full tablet report...
I20260811 05:07:43.196986 11733 heartbeater.cc:503] Master 127.22.49.254:40411 was elected leader, sending a full tablet report...
I20260811 05:07:43.197120 11900 ts_tablet_manager.cc:1428] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260811 05:07:43.271195 11905 raft_consensus.cc:482] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:43.271412 11905 raft_consensus.cc:504] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282f2556b4274c6eb395398b67a206d0" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 34717 } } peers { permanent_uuid: "39c243e9f13549de9baa4c12bec78fbe" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46521 } } peers { permanent_uuid: "54b39976fc38414287d1e269fe95bb94" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35247 } }
I20260811 05:07:43.272506 11905 leader_election.cc:288] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39c243e9f13549de9baa4c12bec78fbe (127.22.49.195:46521), 54b39976fc38414287d1e269fe95bb94 (127.22.49.194:35247)
I20260811 05:07:43.276862 11895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.273035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:48647 (local address 127.22.49.195:46521)
0811 05:07:43.273172 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:43.273176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:43.273426 (+ 250us) server_negotiation.cc:407] Connection header received
0811 05:07:43.273576 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:43.273581 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:43.273638 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:43.273699 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:43.274147 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.274628 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.275786 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.276204 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.276351 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.276405 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:43.276646 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 05:07:43.276727 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 05:07:43.276896 11908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.272824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:46521 (local address 127.22.49.193:48647)
0811 05:07:43.273296 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:43.273312 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:43.273427 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:43.273744 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:43.273750 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:43.273792 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:43.273997 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.274004 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.274785 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.274787 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.275647 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.275656 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.276346 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.276349 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.276505 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.276535 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 05:07:43.276599 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 05:07:43.276686 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"mutex_wait_us":65,"thread_start_us":146,"threads_started":1}
I20260811 05:07:43.276896 11898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.273073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:47551 (local address 127.22.49.194:35247)
0811 05:07:43.273188 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:43.273195 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:43.273488 (+ 293us) server_negotiation.cc:407] Connection header received
0811 05:07:43.273619 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:43.273622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:43.273665 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:43.273764 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:43.274105 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.274616 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.275826 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.276206 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.276351 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.276408 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:43.276707 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 05:07:43.276787 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 05:07:43.276903 11909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.272824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:35247 (local address 127.22.49.193:47551)
0811 05:07:43.273336 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:43.273348 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:43.273497 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:43.273805 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:43.273808 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:43.273850 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:43.273987 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.273992 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.274733 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.274736 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.275665 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.275675 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.276347 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.276350 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.276550 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.276569 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 05:07:43.276668 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 05:07:43.276730 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"mutex_wait_us":281,"spinlock_wait_cycles":28032,"thread_start_us":95,"threads_started":1}
I20260811 05:07:43.277546 11831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ddff9e2542f406a96ab44f7638da699" candidate_uuid: "282f2556b4274c6eb395398b67a206d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39c243e9f13549de9baa4c12bec78fbe" is_pre_election: true
I20260811 05:07:43.277902 11831 raft_consensus.cc:2454] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 282f2556b4274c6eb395398b67a206d0 in term 0.
I20260811 05:07:43.278239 11685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ddff9e2542f406a96ab44f7638da699" candidate_uuid: "282f2556b4274c6eb395398b67a206d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b39976fc38414287d1e269fe95bb94" is_pre_election: true
I20260811 05:07:43.278455 11473 leader_election.cc:302] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 282f2556b4274c6eb395398b67a206d0, 39c243e9f13549de9baa4c12bec78fbe; no voters:
I20260811 05:07:43.278523 11685 raft_consensus.cc:2454] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 282f2556b4274c6eb395398b67a206d0 in term 0.
I20260811 05:07:43.278761 11905 raft_consensus.cc:2781] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:43.278877 11905 raft_consensus.cc:482] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:43.278942 11905 raft_consensus.cc:3037] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:43.280165 11905 raft_consensus.cc:504] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282f2556b4274c6eb395398b67a206d0" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 34717 } } peers { permanent_uuid: "39c243e9f13549de9baa4c12bec78fbe" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46521 } } peers { permanent_uuid: "54b39976fc38414287d1e269fe95bb94" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35247 } }
I20260811 05:07:43.280553 11905 leader_election.cc:288] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [CANDIDATE]: Term 1 election: Requested vote from peers 39c243e9f13549de9baa4c12bec78fbe (127.22.49.195:46521), 54b39976fc38414287d1e269fe95bb94 (127.22.49.194:35247)
I20260811 05:07:43.280903 11831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ddff9e2542f406a96ab44f7638da699" candidate_uuid: "282f2556b4274c6eb395398b67a206d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39c243e9f13549de9baa4c12bec78fbe"
I20260811 05:07:43.281011 11685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ddff9e2542f406a96ab44f7638da699" candidate_uuid: "282f2556b4274c6eb395398b67a206d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54b39976fc38414287d1e269fe95bb94"
I20260811 05:07:43.281032 11831 raft_consensus.cc:3037] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:43.281143 11685 raft_consensus.cc:3037] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:43.282143 11831 raft_consensus.cc:2454] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 282f2556b4274c6eb395398b67a206d0 in term 1.
I20260811 05:07:43.282320 11685 raft_consensus.cc:2454] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 282f2556b4274c6eb395398b67a206d0 in term 1.
I20260811 05:07:43.282471 11473 leader_election.cc:302] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 282f2556b4274c6eb395398b67a206d0, 39c243e9f13549de9baa4c12bec78fbe; no voters:
I20260811 05:07:43.282665 11905 raft_consensus.cc:2781] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:43.282904 11905 raft_consensus.cc:686] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [term 1 LEADER]: Becoming Leader. State: Replica: 282f2556b4274c6eb395398b67a206d0, State: Running, Role: LEADER
I20260811 05:07:43.283293 11905 consensus_queue.cc:237] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282f2556b4274c6eb395398b67a206d0" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 34717 } } peers { permanent_uuid: "39c243e9f13549de9baa4c12bec78fbe" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46521 } } peers { permanent_uuid: "54b39976fc38414287d1e269fe95bb94" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35247 } }
I20260811 05:07:43.286367 11386 catalog_manager.cc:5495] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 282f2556b4274c6eb395398b67a206d0 (127.22.49.193). New cstate: current_term: 1 leader_uuid: "282f2556b4274c6eb395398b67a206d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282f2556b4274c6eb395398b67a206d0" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 34717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39c243e9f13549de9baa4c12bec78fbe" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54b39976fc38414287d1e269fe95bb94" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35247 } health_report { overall_health: UNKNOWN } } }
I20260811 05:07:43.326583 11894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.323047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60280 (local address 127.22.49.193:34717)
0811 05:07:43.323183 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:43.323187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:43.323200 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:07:43.323311 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:43.323314 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:43.323373 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:43.323468 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:43.323718 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.324212 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.325124 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.325382 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.325465 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.325786 (+ 321us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:43.326219 (+ 433us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:43.326330 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:43.326414 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 05:07:43.326467 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:07:43.333206 11685 raft_consensus.cc:1261] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94 [term 1 FOLLOWER]: Refusing update from remote peer 282f2556b4274c6eb395398b67a206d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:43.333287 11831 raft_consensus.cc:1261] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe [term 1 FOLLOWER]: Refusing update from remote peer 282f2556b4274c6eb395398b67a206d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:43.333988 11905 consensus_queue.cc:1035] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39c243e9f13549de9baa4c12bec78fbe" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 46521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:43.334208 11910 consensus_queue.cc:1035] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54b39976fc38414287d1e269fe95bb94" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 35247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:43.343168 11913 mvcc.cc:205] Tried to move back new op lower bound from 7317196240204894208 to 7317196240011030528. Current Snapshot: MvccSnapshot[applied={T|T < 7317196240204894208}]
I20260811 05:07:43.343374 11914 mvcc.cc:205] Tried to move back new op lower bound from 7317196240204894208 to 7317196240011030528. Current Snapshot: MvccSnapshot[applied={T|T < 7317196240204894208}]
I20260811 05:07:43.347786 11915 mvcc.cc:205] Tried to move back new op lower bound from 7317196240204894208 to 7317196240011030528. Current Snapshot: MvccSnapshot[applied={T|T < 7317196240204894208}]
I20260811 05:07:43.354836 11386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:43.355084 11386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:43.357658 11386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e30ff1202a544bcdb933675e07c0e28b: Sending DeleteTablet for 3 replicas of tablet 8ddff9e2542f406a96ab44f7638da699
I20260811 05:07:43.358470 11520 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ddff9e2542f406a96ab44f7638da699 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:43 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:60278
I20260811 05:07:43.358525 11810 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ddff9e2542f406a96ab44f7638da699 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:43 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:59914
I20260811 05:07:43.358664 11663 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ddff9e2542f406a96ab44f7638da699 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:43 UTC) from {username='kudu', principal='kudu/127.22.49.254@KRBTEST.COM'} at 127.0.0.1:53514
I20260811 05:07:43.359099 11925 tablet_replica.cc:330] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0: stopping tablet replica
I20260811 05:07:43.359256 11927 tablet_replica.cc:330] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94: stopping tablet replica
I20260811 05:07:43.359547 11925 raft_consensus.cc:2229] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:07:43.359639 11927 raft_consensus.cc:2229] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:43.360034 11927 raft_consensus.cc:2258] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:43.360080 11925 raft_consensus.cc:2258] T 8ddff9e2542f406a96ab44f7638da699 P 282f2556b4274c6eb395398b67a206d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:43.360177 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 11451
I20260811 05:07:43.362460 11926 tablet_replica.cc:330] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe: stopping tablet replica
I20260811 05:07:43.362884 11926 raft_consensus.cc:2229] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:43.363267 11926 raft_consensus.cc:2258] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:43.364814 11926 ts_tablet_manager.cc:1905] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:43.364956 11927 ts_tablet_manager.cc:1905] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:43.367447 11926 ts_tablet_manager.cc:1918] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:43.367568 11926 log.cc:1196] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/8ddff9e2542f406a96ab44f7638da699
I20260811 05:07:43.367875 11926 ts_tablet_manager.cc:1939] T 8ddff9e2542f406a96ab44f7638da699 P 39c243e9f13549de9baa4c12bec78fbe: Deleting consensus metadata
I20260811 05:07:43.368785 11927 ts_tablet_manager.cc:1918] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:43.368921 11927 log.cc:1196] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/8ddff9e2542f406a96ab44f7638da699
I20260811 05:07:43.369071 11371 catalog_manager.cc:4841] TS 39c243e9f13549de9baa4c12bec78fbe (127.22.49.195:46521): tablet 8ddff9e2542f406a96ab44f7638da699 (table test-table [id=80efad8bc51e4ad4b7da5f1ac32d0653]) successfully deleted
I20260811 05:07:43.369266 11927 ts_tablet_manager.cc:1939] T 8ddff9e2542f406a96ab44f7638da699 P 54b39976fc38414287d1e269fe95bb94: Deleting consensus metadata
I20260811 05:07:43.370654 11370 catalog_manager.cc:4841] TS 54b39976fc38414287d1e269fe95bb94 (127.22.49.194:35247): tablet 8ddff9e2542f406a96ab44f7638da699 (table test-table [id=80efad8bc51e4ad4b7da5f1ac32d0653]) successfully deleted
W20260811 05:07:43.370916 11368 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:34717 (error 108)
I20260811 05:07:43.371829 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 11595
I20260811 05:07:43.372081 11892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.371698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:34717 (local address 127.0.0.1:60290)
0811 05:07:43.371877 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:43.371969 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:34717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 05:07:43.373039 11368 catalog_manager.cc:4584] TS 282f2556b4274c6eb395398b67a206d0 (127.22.49.193:34717): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8ddff9e2542f406a96ab44f7638da699: Network error: Client connection negotiation failed: client connection to 127.22.49.193:34717: connect: Connection refused (error 111)
I20260811 05:07:43.380833 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 11738
I20260811 05:07:43.392771 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 11349
2026-08-11T05:07:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2482 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T05:07:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:43Z Disabled control of system clock
I20260811 05:07:43.427299 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:35795
--webserver_interface=127.22.49.254
--webserver_port=0
--builtin_ntp_servers=127.22.49.212:43173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:35795
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 05:07:43.541002 11932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:43.541304 11932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:43.541352 11932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:43.545486 11932 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:43.545545 11932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:43.545562 11932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:43.545578 11932 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:43.545593 11932 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:43.550266 11932 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:43173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:35795
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:35795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:43.551345 11932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:43.552752 11932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:43.561393 11938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:43.561430 11939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:43.561488 11941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:43.561775 11932 server_base.cc:1034] running on GCE node
I20260811 05:07:43.562353 11932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:43.563591 11932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:43.564783 11932 hybrid_clock.cc:648] HybridClock initialized: now 1786424863564751 us; error 51 us; skew 500 ppm
I20260811 05:07:43.566733 11932 webserver.cc:460] Webserver started at http://127.22.49.254:39379/ using document root <none> and password file <none>
I20260811 05:07:43.567387 11932 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:43.567482 11932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:43.567723 11932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:43.569823 11932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "8f0420a9838346239fb2940ae31fd314"
format_stamp: "Formatted at 2026-08-11 05:07:43 on dist-test-slave-w206"
server_key: "02d4e04983864df4dc920605416d5421"
server_key_iv: "df5c2be9e35c12f2d058e1677fc79385"
server_key_version: "encryptionkey@0"
I20260811 05:07:43.570441 11932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "8f0420a9838346239fb2940ae31fd314"
format_stamp: "Formatted at 2026-08-11 05:07:43 on dist-test-slave-w206"
server_key: "02d4e04983864df4dc920605416d5421"
server_key_iv: "df5c2be9e35c12f2d058e1677fc79385"
server_key_version: "encryptionkey@0"
I20260811 05:07:43.574273 11932 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 05:07:43.576773 11947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:43.578145 11932 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:07:43.578284 11932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "8f0420a9838346239fb2940ae31fd314"
format_stamp: "Formatted at 2026-08-11 05:07:43 on dist-test-slave-w206"
server_key: "02d4e04983864df4dc920605416d5421"
server_key_iv: "df5c2be9e35c12f2d058e1677fc79385"
server_key_version: "encryptionkey@0"
I20260811 05:07:43.578433 11932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:43.611354 11932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:43.612157 11932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:43.612391 11932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:43.619912 11932 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:35795
I20260811 05:07:43.619938 12001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:35795 every 8 connection(s)
I20260811 05:07:43.621021 11932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:43.624025 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 11932
I20260811 05:07:43.624161 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:07:43.624505 22727 external_mini_cluster.cc:1428] Setting key 28feca63a9ac67def6b82c2f6b477e0b
I20260811 05:07:43.624682 12002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:43.631925 12002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314: Bootstrap starting.
I20260811 05:07:43.634003 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.626057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39308 (local address 127.22.49.254:35795)
0811 05:07:43.626713 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:43.626727 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:43.626762 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:07:43.627462 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:43.627480 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:43.627894 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:43.628164 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:43.628505 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.629447 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.630656 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.631215 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.631338 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.632238 (+ 900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:43.632243 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:43.632255 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:43.632642 (+ 387us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:43.632696 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:43.632717 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:43.632811 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:43.632997 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 05:07:43.633285 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":150,"threads_started":1}
I20260811 05:07:43.634390 12002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:43.635178 12002 log.cc:824] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:43.637071 12002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314: No bootstrap required, opened a new log
I20260811 05:07:43.640514 12002 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f0420a9838346239fb2940ae31fd314" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35795 } }
I20260811 05:07:43.640758 12002 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:43.640857 12002 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0420a9838346239fb2940ae31fd314, State: Initialized, Role: FOLLOWER
I20260811 05:07:43.641389 12002 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f0420a9838346239fb2940ae31fd314" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35795 } }
I20260811 05:07:43.641538 12002 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:43.641609 12002 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:43.641706 12002 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:43.642633 12002 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f0420a9838346239fb2940ae31fd314" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35795 } }
I20260811 05:07:43.643003 12002 leader_election.cc:302] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f0420a9838346239fb2940ae31fd314; no voters:
I20260811 05:07:43.643342 12002 leader_election.cc:288] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:43.643497 12007 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:43.643750 12007 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [term 1 LEADER]: Becoming Leader. State: Replica: 8f0420a9838346239fb2940ae31fd314, State: Running, Role: LEADER
I20260811 05:07:43.644042 12007 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f0420a9838346239fb2940ae31fd314" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35795 } }
I20260811 05:07:43.644574 12002 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:43.645790 12008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f0420a9838346239fb2940ae31fd314" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f0420a9838346239fb2940ae31fd314" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35795 } } }
I20260811 05:07:43.645802 12009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f0420a9838346239fb2940ae31fd314. Latest consensus state: current_term: 1 leader_uuid: "8f0420a9838346239fb2940ae31fd314" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f0420a9838346239fb2940ae31fd314" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 35795 } } }
I20260811 05:07:43.645941 12008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:43.645942 12009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:43.646296 12017 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:43.649408 12017 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:43.655262 12017 catalog_manager.cc:1347] Generated new cluster ID: 350621101f0446cda63f1384317a8e9f
I20260811 05:07:43.655335 12017 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:43.670949 12017 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:43.672230 12017 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:43.691124 12017 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314: Generated new TSK 0
I20260811 05:07:43.691912 12017 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:07:43.699855 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.193:0
--local_ip_for_outbound_sockets=127.22.49.193
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35795
--builtin_ntp_servers=127.22.49.212:43173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 05:07:43.819794 12027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:43.820101 12027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:43.820143 12027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:43.824311 12027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:43.824393 12027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:43.824452 12027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.193
I20260811 05:07:43.829820 12027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:43173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.49.193
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.193
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:43.831025 12027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:43.832455 12027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:43.842144 12033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:43.842154 12032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:43.842264 12035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:43.842388 12027 server_base.cc:1034] running on GCE node
I20260811 05:07:43.842856 12027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:43.843585 12027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:43.844770 12027 hybrid_clock.cc:648] HybridClock initialized: now 1786424863844735 us; error 51 us; skew 500 ppm
I20260811 05:07:43.846776 12027 webserver.cc:460] Webserver started at http://127.22.49.193:35127/ using document root <none> and password file <none>
I20260811 05:07:43.847420 12027 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:43.847517 12027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:43.847752 12027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:43.849800 12027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/data/instance:
uuid: "893a713818c44cb0b190be0a323b259b"
format_stamp: "Formatted at 2026-08-11 05:07:43 on dist-test-slave-w206"
server_key: "d89bd0b1b7e5e74f641bfed5741ca5bb"
server_key_iv: "0195fcaa54838713156ec93fdf205449"
server_key_version: "encryptionkey@0"
I20260811 05:07:43.850373 12027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance:
uuid: "893a713818c44cb0b190be0a323b259b"
format_stamp: "Formatted at 2026-08-11 05:07:43 on dist-test-slave-w206"
server_key: "d89bd0b1b7e5e74f641bfed5741ca5bb"
server_key_iv: "0195fcaa54838713156ec93fdf205449"
server_key_version: "encryptionkey@0"
I20260811 05:07:43.854072 12027 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 05:07:43.856686 12043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:43.857884 12027 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 05:07:43.858022 12027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/wal
uuid: "893a713818c44cb0b190be0a323b259b"
format_stamp: "Formatted at 2026-08-11 05:07:43 on dist-test-slave-w206"
server_key: "d89bd0b1b7e5e74f641bfed5741ca5bb"
server_key_iv: "0195fcaa54838713156ec93fdf205449"
server_key_version: "encryptionkey@0"
I20260811 05:07:43.858134 12027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:43.885614 12027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:43.886365 12027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:43.886579 12027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:43.887245 12027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:43.888252 12027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:43.888331 12027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:43.888406 12027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:43.888449 12027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:43.897631 12027 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.193:41669
I20260811 05:07:43.897658 12166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.193:41669 every 8 connection(s)
I20260811 05:07:43.898523 12027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/data/info.pb
I20260811 05:07:43.907663 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.900318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:38347 (local address 127.22.49.254:35795)
0811 05:07:43.900466 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:43.900470 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:43.901521 (+ 1051us) server_negotiation.cc:407] Connection header received
0811 05:07:43.902933 (+ 1412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:43.902936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:43.903019 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:43.903125 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:43.903977 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.904519 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.905655 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.905887 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.905997 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.907122 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:43.907125 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:43.907127 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:43.907139 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:43.907156 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:43.907163 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:43.907243 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:43.907433 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 05:07:43.907515 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 05:07:43.908445 12169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:43.900740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35795 (local address 127.22.49.193:38347)
0811 05:07:43.901374 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:43.901413 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:43.902717 (+ 1304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:43.903292 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:43.903299 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:43.903383 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:43.903834 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.903846 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.904650 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.904659 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.905517 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:43.905526 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:43.906036 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:43.906040 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:43.906196 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:43.906809 (+ 613us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:07:43.906811 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:43.906850 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:07:43.906909 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:43.907251 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:43.907263 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:43.907270 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 05:07:43.907433 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 05:07:43.907694 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":119,"threads_started":1}
I20260811 05:07:43.908573 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 12027
I20260811 05:07:43.908743 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-0/wal/instance
I20260811 05:07:43.909071 22727 external_mini_cluster.cc:1428] Setting key f2b1fa9b9dcfcd654e31d4ff5e368f91
I20260811 05:07:43.910110 12167 heartbeater.cc:347] Connected to a master server at 127.22.49.254:35795
I20260811 05:07:43.910418 12167 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:43.910952 12167 heartbeater.cc:511] Master 127.22.49.254:35795 requested a full tablet report, sending...
I20260811 05:07:43.911240 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.194:0
--local_ip_for_outbound_sockets=127.22.49.194
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35795
--builtin_ntp_servers=127.22.49.212:43173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 05:07:43.912524 11966 ts_manager.cc:194] Registered new tserver with Master: 893a713818c44cb0b190be0a323b259b (127.22.49.193:41669)
I20260811 05:07:43.914187 11966 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.49.193:38347
W20260811 05:07:44.025554 12170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:44.025887 12170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:44.025962 12170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:44.030078 12170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:44.030171 12170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:44.030265 12170 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.194
I20260811 05:07:44.035158 12170 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:43173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.49.194
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12170
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.194
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:44.036324 12170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:44.037714 12170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:44.048213 12176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:44.048162 12175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:44.048314 12170 server_base.cc:1034] running on GCE node
W20260811 05:07:44.048162 12178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:44.048923 12170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:44.049537 12170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:44.050715 12170 hybrid_clock.cc:648] HybridClock initialized: now 1786424864050687 us; error 42 us; skew 500 ppm
I20260811 05:07:44.052863 12170 webserver.cc:460] Webserver started at http://127.22.49.194:40029/ using document root <none> and password file <none>
I20260811 05:07:44.053476 12170 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:44.053548 12170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:44.053777 12170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:44.056010 12170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/data/instance:
uuid: "439b9025c5484ddcba78f69b2c03cdf9"
format_stamp: "Formatted at 2026-08-11 05:07:44 on dist-test-slave-w206"
server_key: "5910374e0fc574edb107b09af40c682a"
server_key_iv: "070f097bb9232a29f936bcce2125fdea"
server_key_version: "encryptionkey@0"
I20260811 05:07:44.056613 12170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance:
uuid: "439b9025c5484ddcba78f69b2c03cdf9"
format_stamp: "Formatted at 2026-08-11 05:07:44 on dist-test-slave-w206"
server_key: "5910374e0fc574edb107b09af40c682a"
server_key_iv: "070f097bb9232a29f936bcce2125fdea"
server_key_version: "encryptionkey@0"
I20260811 05:07:44.060598 12170 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:07:44.063256 12185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:44.064478 12170 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260811 05:07:44.064576 12170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/wal
uuid: "439b9025c5484ddcba78f69b2c03cdf9"
format_stamp: "Formatted at 2026-08-11 05:07:44 on dist-test-slave-w206"
server_key: "5910374e0fc574edb107b09af40c682a"
server_key_iv: "070f097bb9232a29f936bcce2125fdea"
server_key_version: "encryptionkey@0"
I20260811 05:07:44.064718 12170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:44.085947 12170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:44.086663 12170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:44.086877 12170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:44.087522 12170 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:44.088486 12170 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:44.088533 12170 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:44.088601 12170 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:44.088637 12170 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:44.098086 12170 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.194:41649
I20260811 05:07:44.098110 12308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.194:41649 every 8 connection(s)
I20260811 05:07:44.099071 12170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/data/info.pb
I20260811 05:07:44.099538 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 12170
I20260811 05:07:44.099681 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/wal/instance
I20260811 05:07:44.100252 22727 external_mini_cluster.cc:1428] Setting key 733a1d6425ef5ec79b2d9ab0de264200
I20260811 05:07:44.102706 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.49.195:0
--local_ip_for_outbound_sockets=127.22.49.195
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35795
--builtin_ntp_servers=127.22.49.212:43173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 05:07:44.111061 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.101269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.194:37583 (local address 127.22.49.254:35795)
0811 05:07:44.101444 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:44.101449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:44.102624 (+ 1175us) server_negotiation.cc:407] Connection header received
0811 05:07:44.104922 (+ 2298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:44.104927 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:44.104997 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:44.105098 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:44.106111 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.106657 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.108634 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.108868 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.108960 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.110434 (+ 1474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:44.110437 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:44.110439 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:44.110453 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:44.110473 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:44.110482 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:44.110563 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:44.110807 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 05:07:44.110874 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 05:07:44.112450 12311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.101622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35795 (local address 127.22.49.194:37583)
0811 05:07:44.102461 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:44.102522 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:44.104627 (+ 2105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:44.105257 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:44.105264 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:44.105393 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:44.105892 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.105941 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.106801 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.106807 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.108464 (+ 1657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.108480 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.109050 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.109058 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.109317 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.110067 (+ 750us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:07:44.110072 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:44.110138 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:07:44.110238 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:44.110588 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:44.110600 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:44.110610 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 05:07:44.110764 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 05:07:44.111133 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":148,"threads_started":1}
I20260811 05:07:44.113806 12309 heartbeater.cc:347] Connected to a master server at 127.22.49.254:35795
I20260811 05:07:44.114054 12309 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:44.114616 12309 heartbeater.cc:511] Master 127.22.49.254:35795 requested a full tablet report, sending...
I20260811 05:07:44.115775 11966 ts_manager.cc:194] Registered new tserver with Master: 439b9025c5484ddcba78f69b2c03cdf9 (127.22.49.194:41649)
I20260811 05:07:44.116353 11966 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.49.194:37583
W20260811 05:07:44.222364 12312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:44.222638 12312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:44.222676 12312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:44.226768 12312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:44.226835 12312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:44.226891 12312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.49.195
I20260811 05:07:44.232414 12312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:43173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.49.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.49.195
--webserver_port=0
--tserver_master_addrs=127.22.49.254:35795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.49.195
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:44.233757 12312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:44.235212 12312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:44.246330 12317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:44.246387 12312 server_base.cc:1034] running on GCE node
W20260811 05:07:44.246562 12318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:44.246268 12320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:44.247138 12312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:44.247804 12312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:44.248998 12312 hybrid_clock.cc:648] HybridClock initialized: now 1786424864248967 us; error 42 us; skew 500 ppm
I20260811 05:07:44.250847 12312 webserver.cc:460] Webserver started at http://127.22.49.195:46145/ using document root <none> and password file <none>
I20260811 05:07:44.251500 12312 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:44.251595 12312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:44.251840 12312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:44.253917 12312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/data/instance:
uuid: "b61e7bd49e03464e957ac97b4608a0da"
format_stamp: "Formatted at 2026-08-11 05:07:44 on dist-test-slave-w206"
server_key: "02b5efc86846d676680b7d62aeed69b4"
server_key_iv: "cbe452846a5769894e60aec5fa92f80f"
server_key_version: "encryptionkey@0"
I20260811 05:07:44.254487 12312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance:
uuid: "b61e7bd49e03464e957ac97b4608a0da"
format_stamp: "Formatted at 2026-08-11 05:07:44 on dist-test-slave-w206"
server_key: "02b5efc86846d676680b7d62aeed69b4"
server_key_iv: "cbe452846a5769894e60aec5fa92f80f"
server_key_version: "encryptionkey@0"
I20260811 05:07:44.258383 12312 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 05:07:44.260982 12326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:44.262434 12312 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:07:44.262574 12312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/wal
uuid: "b61e7bd49e03464e957ac97b4608a0da"
format_stamp: "Formatted at 2026-08-11 05:07:44 on dist-test-slave-w206"
server_key: "02b5efc86846d676680b7d62aeed69b4"
server_key_iv: "cbe452846a5769894e60aec5fa92f80f"
server_key_version: "encryptionkey@0"
I20260811 05:07:44.262696 12312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:44.287352 12312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:44.288100 12312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:44.288314 12312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:44.288951 12312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 05:07:44.289920 12312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 05:07:44.289992 12312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:44.290066 12312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 05:07:44.290110 12312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:44.298828 12312 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.195:37805
I20260811 05:07:44.298863 12452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.195:37805 every 8 connection(s)
I20260811 05:07:44.299782 12312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/data/info.pb
I20260811 05:07:44.301272 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 12312
I20260811 05:07:44.301394 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/wal/instance
I20260811 05:07:44.301729 22727 external_mini_cluster.cc:1428] Setting key 289fc5e2426cfc5c4221574884c7439e
I20260811 05:07:44.309051 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.301765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.195:46681 (local address 127.22.49.254:35795)
0811 05:07:44.301926 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:44.301931 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:44.303113 (+ 1182us) server_negotiation.cc:407] Connection header received
0811 05:07:44.304470 (+ 1357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:44.304473 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:44.304518 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:44.304586 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:44.305474 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.305991 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.307195 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.307407 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.307484 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.308525 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:44.308528 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:44.308530 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:44.308542 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:44.308561 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:44.308568 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:44.308627 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:44.308886 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 05:07:44.308939 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 05:07:44.309942 12456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.302197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:35795 (local address 127.22.49.195:46681)
0811 05:07:44.302929 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:44.303007 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:44.304287 (+ 1280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:44.304749 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:44.304755 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:44.304836 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:07:44.305355 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.305368 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.306097 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.306099 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.307091 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.307101 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.307538 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.307540 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.307675 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.308225 (+ 550us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 05:07:44.308227 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:07:44.308268 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 05:07:44.308379 (+ 111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:07:44.308741 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:07:44.308750 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:07:44.308755 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 05:07:44.308871 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 05:07:44.309088 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":148,"threads_started":1}
I20260811 05:07:44.311097 12453 heartbeater.cc:347] Connected to a master server at 127.22.49.254:35795
I20260811 05:07:44.311291 12453 heartbeater.cc:464] Registering TS with master...
I20260811 05:07:44.311791 12453 heartbeater.cc:511] Master 127.22.49.254:35795 requested a full tablet report, sending...
I20260811 05:07:44.312733 11966 ts_manager.cc:194] Registered new tserver with Master: b61e7bd49e03464e957ac97b4608a0da (127.22.49.195:37805)
I20260811 05:07:44.313262 11966 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.49.195:46681
I20260811 05:07:44.315701 22727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 05:07:44.321628 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.317691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39310 (local address 127.22.49.254:35795)
0811 05:07:44.317901 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:44.317906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:44.318036 (+ 130us) server_negotiation.cc:407] Connection header received
0811 05:07:44.318190 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:44.318193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:44.318241 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:44.318338 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:44.318621 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.319206 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.320052 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.320272 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.320378 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.321174 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:44.321178 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:44.321179 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:44.321191 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:44.321208 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:44.321216 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:44.321335 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:44.321429 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 05:07:44.321480 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260811 05:07:44.324430 11966 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39310:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 05:07:44.328048 11966 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 05:07:44.342072 12466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.336575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:37805 (local address 127.0.0.1:58616)
0811 05:07:44.336931 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:44.336977 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:44.337100 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:44.338188 (+ 1088us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:44.338194 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:44.338215 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:44.338370 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.338378 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.339519 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.339524 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.340476 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.340485 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.341529 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.341533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.341662 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.341702 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 05:07:44.341812 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 05:07:44.341922 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":99,"threads_started":1}
I20260811 05:07:44.342118 12469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.336831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58616 (local address 127.22.49.195:37805)
0811 05:07:44.337682 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:44.337692 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:44.337713 (+ 21us) server_negotiation.cc:407] Connection header received
0811 05:07:44.337810 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:44.337815 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:44.338024 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:44.338189 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:44.338473 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.339413 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.340615 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.341395 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.341500 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.341697 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:44.341856 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 05:07:44.341957 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":738,"thread_start_us":139,"threads_started":1}
I20260811 05:07:44.343389 12471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.337627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:41669 (local address 127.0.0.1:44554)
0811 05:07:44.337879 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:44.337892 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:44.337977 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:44.338815 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:44.338819 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:44.338837 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:44.338935 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.338941 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.340328 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.340332 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.341580 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.341590 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.343017 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.343020 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.343103 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.343125 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 05:07:44.343189 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 05:07:44.343258 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":103,"threads_started":1}
I20260811 05:07:44.343703 12472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.338068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44554 (local address 127.22.49.193:41669)
0811 05:07:44.338475 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:44.338484 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:44.338504 (+ 20us) server_negotiation.cc:407] Connection header received
0811 05:07:44.338564 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:44.338567 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:44.338688 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:44.338806 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:44.339067 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.340192 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.341717 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.342868 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.343017 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.343198 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:44.343257 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 05:07:44.343347 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":107,"threads_started":1}
I20260811 05:07:44.343866 12468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.336627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:41649 (local address 127.0.0.1:37962)
0811 05:07:44.337418 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:44.337432 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:44.337525 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:44.339543 (+ 2018us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:44.339546 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:44.339563 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:44.339650 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.339655 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.341109 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.341113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.342126 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.342139 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.343504 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.343508 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.343593 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.343616 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 05:07:44.343666 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 05:07:44.343731 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":724,"thread_start_us":124,"threads_started":1}
I20260811 05:07:44.344527 12470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.337389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37962 (local address 127.22.49.194:41649)
0811 05:07:44.339102 (+ 1713us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:44.339115 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:44.339140 (+ 25us) server_negotiation.cc:407] Connection header received
0811 05:07:44.339215 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:44.339220 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:44.339387 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:44.339802 (+ 415us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:44.339929 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.340985 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.342538 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.343362 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.344032 (+ 670us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.344202 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:44.344250 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 05:07:44.344334 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1557,"thread_start_us":183,"threads_started":1}
I20260811 05:07:44.345422 12385 tablet_service.cc:1467] Processing CreateTablet for tablet 4ce92dcd75dc4b5ba960aa0c8cf3d56e (DEFAULT_TABLE table=test-table [id=d1cf979eb7bc4c8fab9601d124757424]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:44.346565 12385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ce92dcd75dc4b5ba960aa0c8cf3d56e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:44.346511 12098 tablet_service.cc:1467] Processing CreateTablet for tablet 4ce92dcd75dc4b5ba960aa0c8cf3d56e (DEFAULT_TABLE table=test-table [id=d1cf979eb7bc4c8fab9601d124757424]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:44.347412 12098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ce92dcd75dc4b5ba960aa0c8cf3d56e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:44.347118 12240 tablet_service.cc:1467] Processing CreateTablet for tablet 4ce92dcd75dc4b5ba960aa0c8cf3d56e (DEFAULT_TABLE table=test-table [id=d1cf979eb7bc4c8fab9601d124757424]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 05:07:44.348019 12240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ce92dcd75dc4b5ba960aa0c8cf3d56e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:44.353235 12473 tablet_bootstrap.cc:492] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b: Bootstrap starting.
I20260811 05:07:44.354770 12475 tablet_bootstrap.cc:492] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9: Bootstrap starting.
I20260811 05:07:44.355347 12474 tablet_bootstrap.cc:492] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da: Bootstrap starting.
I20260811 05:07:44.355775 12473 tablet_bootstrap.cc:654] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:44.356638 12475 tablet_bootstrap.cc:654] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:44.356662 12473 log.cc:824] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:44.357425 12474 tablet_bootstrap.cc:654] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:44.357512 12475 log.cc:824] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:44.358228 12474 log.cc:824] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:44.359403 12475 tablet_bootstrap.cc:492] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9: No bootstrap required, opened a new log
I20260811 05:07:44.359567 12473 tablet_bootstrap.cc:492] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b: No bootstrap required, opened a new log
I20260811 05:07:44.359609 12475 ts_tablet_manager.cc:1397] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 05:07:44.359753 12473 ts_tablet_manager.cc:1397] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 05:07:44.360106 12474 tablet_bootstrap.cc:492] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da: No bootstrap required, opened a new log
I20260811 05:07:44.360301 12474 ts_tablet_manager.cc:1397] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 05:07:44.363133 12475 raft_consensus.cc:348] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b61e7bd49e03464e957ac97b4608a0da" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37805 } } peers { permanent_uuid: "439b9025c5484ddcba78f69b2c03cdf9" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41649 } } peers { permanent_uuid: "893a713818c44cb0b190be0a323b259b" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41669 } }
I20260811 05:07:44.363442 12475 raft_consensus.cc:374] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:44.363499 12475 raft_consensus.cc:729] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 439b9025c5484ddcba78f69b2c03cdf9, State: Initialized, Role: FOLLOWER
I20260811 05:07:44.363973 12475 consensus_queue.cc:260] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b61e7bd49e03464e957ac97b4608a0da" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37805 } } peers { permanent_uuid: "439b9025c5484ddcba78f69b2c03cdf9" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41649 } } peers { permanent_uuid: "893a713818c44cb0b190be0a323b259b" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41669 } }
I20260811 05:07:44.364071 12473 raft_consensus.cc:348] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b61e7bd49e03464e957ac97b4608a0da" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37805 } } peers { permanent_uuid: "439b9025c5484ddcba78f69b2c03cdf9" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41649 } } peers { permanent_uuid: "893a713818c44cb0b190be0a323b259b" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41669 } }
I20260811 05:07:44.364420 12473 raft_consensus.cc:374] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:44.364476 12473 raft_consensus.cc:729] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 893a713818c44cb0b190be0a323b259b, State: Initialized, Role: FOLLOWER
I20260811 05:07:44.364318 12474 raft_consensus.cc:348] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b61e7bd49e03464e957ac97b4608a0da" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37805 } } peers { permanent_uuid: "439b9025c5484ddcba78f69b2c03cdf9" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41649 } } peers { permanent_uuid: "893a713818c44cb0b190be0a323b259b" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41669 } }
I20260811 05:07:44.364542 12474 raft_consensus.cc:374] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:44.364595 12474 raft_consensus.cc:729] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61e7bd49e03464e957ac97b4608a0da, State: Initialized, Role: FOLLOWER
I20260811 05:07:44.364916 12309 heartbeater.cc:503] Master 127.22.49.254:35795 was elected leader, sending a full tablet report...
I20260811 05:07:44.365051 12474 consensus_queue.cc:260] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b61e7bd49e03464e957ac97b4608a0da" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37805 } } peers { permanent_uuid: "439b9025c5484ddcba78f69b2c03cdf9" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41649 } } peers { permanent_uuid: "893a713818c44cb0b190be0a323b259b" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41669 } }
I20260811 05:07:44.365712 12453 heartbeater.cc:503] Master 127.22.49.254:35795 was elected leader, sending a full tablet report...
I20260811 05:07:44.365972 12473 consensus_queue.cc:260] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b61e7bd49e03464e957ac97b4608a0da" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37805 } } peers { permanent_uuid: "439b9025c5484ddcba78f69b2c03cdf9" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41649 } } peers { permanent_uuid: "893a713818c44cb0b190be0a323b259b" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41669 } }
I20260811 05:07:44.366055 12474 ts_tablet_manager.cc:1428] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 05:07:44.366581 12167 heartbeater.cc:503] Master 127.22.49.254:35795 was elected leader, sending a full tablet report...
I20260811 05:07:44.366860 12473 ts_tablet_manager.cc:1428] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 05:07:44.367324 12475 ts_tablet_manager.cc:1428] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
W20260811 05:07:44.399796 12168 tablet.cc:2369] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 05:07:44.550889 12455 tablet.cc:2369] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:07:44.598829 12482 raft_consensus.cc:482] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 05:07:44.599134 12482 raft_consensus.cc:504] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b61e7bd49e03464e957ac97b4608a0da" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37805 } } peers { permanent_uuid: "439b9025c5484ddcba78f69b2c03cdf9" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41649 } } peers { permanent_uuid: "893a713818c44cb0b190be0a323b259b" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41669 } }
W20260811 05:07:44.600453 12310 tablet.cc:2369] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 05:07:44.600488 12482 leader_election.cc:288] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b61e7bd49e03464e957ac97b4608a0da (127.22.49.195:37805), 439b9025c5484ddcba78f69b2c03cdf9 (127.22.49.194:41649)
I20260811 05:07:44.604864 12484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.600766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.194:41649 (local address 127.22.49.193:58723)
0811 05:07:44.601221 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:44.601236 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:44.601373 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:44.601699 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:44.601704 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:44.601721 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:44.601866 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.601870 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.602645 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.602648 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.603576 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.603585 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.604381 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.604385 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.604496 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.604522 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 05:07:44.604603 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 05:07:44.604666 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":57,"thread_start_us":113,"threads_started":1}
I20260811 05:07:44.604921 12470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.601186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:58723 (local address 127.22.49.194:41649)
0811 05:07:44.601330 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:44.601335 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:44.601351 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:07:44.601519 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:44.601522 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:44.601564 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:44.601662 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:44.602016 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.602506 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.603720 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.604189 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.604286 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.604326 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:44.604656 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 05:07:44.604752 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 05:07:44.605053 12483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.600766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.195:37805 (local address 127.22.49.193:59797)
0811 05:07:44.601166 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:44.601179 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:07:44.601329 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:07:44.601649 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:07:44.601654 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:07:44.601678 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 05:07:44.601860 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.601866 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.602608 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.602611 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.603728 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:07:44.603739 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.604538 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.604541 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:07:44.604685 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.604708 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 05:07:44.604799 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 05:07:44.604865 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":77,"thread_start_us":113,"threads_started":1}
I20260811 05:07:44.605065 12469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.600918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.49.193:59797 (local address 127.22.49.195:37805)
0811 05:07:44.601055 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:44.601061 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:44.601284 (+ 223us) server_negotiation.cc:407] Connection header received
0811 05:07:44.601477 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:44.601483 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:44.601540 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:44.601598 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 05:07:44.601986 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.602487 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.603886 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.604385 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.604508 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.604554 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:44.604845 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 05:07:44.604935 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 05:07:44.605712 12405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ce92dcd75dc4b5ba960aa0c8cf3d56e" candidate_uuid: "893a713818c44cb0b190be0a323b259b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61e7bd49e03464e957ac97b4608a0da" is_pre_election: true
I20260811 05:07:44.605710 12260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ce92dcd75dc4b5ba960aa0c8cf3d56e" candidate_uuid: "893a713818c44cb0b190be0a323b259b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "439b9025c5484ddcba78f69b2c03cdf9" is_pre_election: true
I20260811 05:07:44.606031 12260 raft_consensus.cc:2454] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 893a713818c44cb0b190be0a323b259b in term 0.
I20260811 05:07:44.606031 12405 raft_consensus.cc:2454] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 893a713818c44cb0b190be0a323b259b in term 0.
I20260811 05:07:44.606572 12046 leader_election.cc:302] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 439b9025c5484ddcba78f69b2c03cdf9, 893a713818c44cb0b190be0a323b259b, b61e7bd49e03464e957ac97b4608a0da; no voters:
I20260811 05:07:44.606891 12482 raft_consensus.cc:2781] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 05:07:44.607025 12482 raft_consensus.cc:482] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 05:07:44.607108 12482 raft_consensus.cc:3037] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:44.608219 12482 raft_consensus.cc:504] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b61e7bd49e03464e957ac97b4608a0da" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37805 } } peers { permanent_uuid: "439b9025c5484ddcba78f69b2c03cdf9" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41649 } } peers { permanent_uuid: "893a713818c44cb0b190be0a323b259b" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41669 } }
I20260811 05:07:44.608592 12482 leader_election.cc:288] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [CANDIDATE]: Term 1 election: Requested vote from peers b61e7bd49e03464e957ac97b4608a0da (127.22.49.195:37805), 439b9025c5484ddcba78f69b2c03cdf9 (127.22.49.194:41649)
I20260811 05:07:44.608966 12405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ce92dcd75dc4b5ba960aa0c8cf3d56e" candidate_uuid: "893a713818c44cb0b190be0a323b259b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61e7bd49e03464e957ac97b4608a0da"
I20260811 05:07:44.609035 12260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ce92dcd75dc4b5ba960aa0c8cf3d56e" candidate_uuid: "893a713818c44cb0b190be0a323b259b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "439b9025c5484ddcba78f69b2c03cdf9"
I20260811 05:07:44.609083 12405 raft_consensus.cc:3037] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:44.609237 12260 raft_consensus.cc:3037] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:44.610215 12405 raft_consensus.cc:2454] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 893a713818c44cb0b190be0a323b259b in term 1.
I20260811 05:07:44.610317 12260 raft_consensus.cc:2454] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 893a713818c44cb0b190be0a323b259b in term 1.
I20260811 05:07:44.610585 12045 leader_election.cc:302] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 893a713818c44cb0b190be0a323b259b, b61e7bd49e03464e957ac97b4608a0da; no voters:
I20260811 05:07:44.610767 12482 raft_consensus.cc:2781] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:44.611063 12482 raft_consensus.cc:686] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [term 1 LEADER]: Becoming Leader. State: Replica: 893a713818c44cb0b190be0a323b259b, State: Running, Role: LEADER
I20260811 05:07:44.611423 12482 consensus_queue.cc:237] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b61e7bd49e03464e957ac97b4608a0da" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37805 } } peers { permanent_uuid: "439b9025c5484ddcba78f69b2c03cdf9" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41649 } } peers { permanent_uuid: "893a713818c44cb0b190be0a323b259b" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41669 } }
I20260811 05:07:44.614745 11966 catalog_manager.cc:5495] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b reported cstate change: term changed from 0 to 1, leader changed from <none> to 893a713818c44cb0b190be0a323b259b (127.22.49.193). New cstate: current_term: 1 leader_uuid: "893a713818c44cb0b190be0a323b259b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b61e7bd49e03464e957ac97b4608a0da" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "439b9025c5484ddcba78f69b2c03cdf9" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "893a713818c44cb0b190be0a323b259b" member_type: VOTER last_known_addr { host: "127.22.49.193" port: 41669 } health_report { overall_health: HEALTHY } } }
I20260811 05:07:44.635022 12472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.631476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44566 (local address 127.22.49.193:41669)
0811 05:07:44.631630 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:44.631634 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:44.631651 (+ 17us) server_negotiation.cc:407] Connection header received
0811 05:07:44.631743 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:44.631751 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:44.631808 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:44.631924 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:07:44.632177 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.632693 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.633559 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:44.633781 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:44.633907 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:44.634201 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:07:44.634584 (+ 383us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:07:44.634719 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:44.634783 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 05:07:44.634836 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 05:07:44.640722 12260 raft_consensus.cc:1261] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9 [term 1 FOLLOWER]: Refusing update from remote peer 893a713818c44cb0b190be0a323b259b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:44.640722 12405 raft_consensus.cc:1261] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da [term 1 FOLLOWER]: Refusing update from remote peer 893a713818c44cb0b190be0a323b259b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:07:44.641481 12485 consensus_queue.cc:1035] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61e7bd49e03464e957ac97b4608a0da" member_type: VOTER last_known_addr { host: "127.22.49.195" port: 37805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:44.641672 12482 consensus_queue.cc:1035] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [LEADER]: Connected to new peer: Peer: permanent_uuid: "439b9025c5484ddcba78f69b2c03cdf9" member_type: VOTER last_known_addr { host: "127.22.49.194" port: 41649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:07:44.650671 12490 mvcc.cc:205] Tried to move back new op lower bound from 7317196245561192448 to 7317196245451018240. Current Snapshot: MvccSnapshot[applied={T|T < 7317196245561192448 or (T in {7317196245561192448})}]
I20260811 05:07:44.652549 12489 mvcc.cc:205] Tried to move back new op lower bound from 7317196245561192448 to 7317196245451018240. Current Snapshot: MvccSnapshot[applied={T|T < 7317196245561192448}]
I20260811 05:07:44.658043 11966 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:44.658258 11966 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 05:07:44.660768 11966 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8f0420a9838346239fb2940ae31fd314: Sending DeleteTablet for 3 replicas of tablet 4ce92dcd75dc4b5ba960aa0c8cf3d56e
I20260811 05:07:44.661612 12240 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ce92dcd75dc4b5ba960aa0c8cf3d56e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:44 UTC) from {username='slave'} at 127.0.0.1:37962
I20260811 05:07:44.661635 12385 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ce92dcd75dc4b5ba960aa0c8cf3d56e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:44 UTC) from {username='slave'} at 127.0.0.1:58616
I20260811 05:07:44.662119 12098 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ce92dcd75dc4b5ba960aa0c8cf3d56e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 05:07:44 UTC) from {username='slave'} at 127.0.0.1:44554
I20260811 05:07:44.662171 12499 tablet_replica.cc:330] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9: stopping tablet replica
I20260811 05:07:44.662549 12499 raft_consensus.cc:2229] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:44.662575 12502 tablet_replica.cc:330] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b: stopping tablet replica
I20260811 05:07:44.662930 12502 raft_consensus.cc:2229] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [term 1 LEADER]: Raft consensus shutting down.
I20260811 05:07:44.662927 12499 raft_consensus.cc:2258] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:44.663339 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 12027
I20260811 05:07:44.663466 12502 raft_consensus.cc:2258] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 893a713818c44cb0b190be0a323b259b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:44.664880 12499 ts_tablet_manager.cc:1905] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:44.666074 12501 tablet_replica.cc:330] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da: stopping tablet replica
I20260811 05:07:44.666388 12501 raft_consensus.cc:2229] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 05:07:44.666685 12501 raft_consensus.cc:2258] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 05:07:44.668084 12499 ts_tablet_manager.cc:1918] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:44.668206 12499 log.cc:1196] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-1/wal/wals/4ce92dcd75dc4b5ba960aa0c8cf3d56e
I20260811 05:07:44.668278 12501 ts_tablet_manager.cc:1905] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 05:07:44.668586 12499 ts_tablet_manager.cc:1939] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P 439b9025c5484ddcba78f69b2c03cdf9: Deleting consensus metadata
I20260811 05:07:44.669751 11950 catalog_manager.cc:4841] TS 439b9025c5484ddcba78f69b2c03cdf9 (127.22.49.194:41649): tablet 4ce92dcd75dc4b5ba960aa0c8cf3d56e (table test-table [id=d1cf979eb7bc4c8fab9601d124757424]) successfully deleted
I20260811 05:07:44.671698 12501 ts_tablet_manager.cc:1918] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 05:07:44.671821 12501 log.cc:1196] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da: Deleting WAL directory at /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786424592714304-22727-0/minicluster-data/ts-2/wal/wals/4ce92dcd75dc4b5ba960aa0c8cf3d56e
I20260811 05:07:44.672149 12501 ts_tablet_manager.cc:1939] T 4ce92dcd75dc4b5ba960aa0c8cf3d56e P b61e7bd49e03464e957ac97b4608a0da: Deleting consensus metadata
I20260811 05:07:44.673414 11949 catalog_manager.cc:4841] TS b61e7bd49e03464e957ac97b4608a0da (127.22.49.195:37805): tablet 4ce92dcd75dc4b5ba960aa0c8cf3d56e (table test-table [id=d1cf979eb7bc4c8fab9601d124757424]) successfully deleted
W20260811 05:07:44.673497 11948 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.49.193:41669 (error 108)
I20260811 05:07:44.674247 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 12170
I20260811 05:07:44.674557 12468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:44.674179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.193:41669 (local address 127.0.0.1:44574)
0811 05:07:44.674383 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 05:07:44.674461 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.193:41669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260811 05:07:44.677191 11948 catalog_manager.cc:4584] TS 893a713818c44cb0b190be0a323b259b (127.22.49.193:41669): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4ce92dcd75dc4b5ba960aa0c8cf3d56e: Network error: Client connection negotiation failed: client connection to 127.22.49.193:41669: connect: Connection refused (error 111)
I20260811 05:07:44.683907 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 12312
I20260811 05:07:44.692718 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 11932
2026-08-11T05:07:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1299 ms)
[----------] 6 tests from EncryptionPolicyTest (11198 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:44 dist-test-slave-w206 krb5kdc[12506](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:44 dist-test-slave-w206 krb5kdc[12506](info): set up 2 sockets
Aug 11 05:07:44 dist-test-slave-w206 krb5kdc[12506](info): commencing operation
krb5kdc: starting...
W20260811 05:07:45.798453 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:07:45 dist-test-slave-w206 krb5kdc[12506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:07:45.935222 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40069
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:46.058485 12520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:46.058808 12520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:46.058887 12520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:46.063126 12520 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:46.063220 12520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:46.063256 12520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:46.063318 12520 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:46.063371 12520 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:46.068926 12520 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40069
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:46.070086 12520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:46.071172 12520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:46.079880 12529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:46.079835 12526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:46.079918 12525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:46.080315 12520 server_base.cc:1034] running on GCE node
I20260811 05:07:46.080895 12520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:46.082002 12520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:46.083194 12520 hybrid_clock.cc:648] HybridClock initialized: now 1786424866083170 us; error 44 us; skew 500 ppm
Aug 11 05:07:46 dist-test-slave-w206 krb5kdc[12506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424866, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:46.089923 12520 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:07:46.090890 12520 webserver.cc:460] Webserver started at http://127.0.0.1:37575/ using document root <none> and password file <none>
I20260811 05:07:46.091498 12520 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:46.091599 12520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:46.091840 12520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:46.093909 12520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "3068169a851a4f03a9ab7b85e5ebf65e"
format_stamp: "Formatted at 2026-08-11 05:07:46 on dist-test-slave-w206"
server_key: "19e60620fd9af38348e8998f2b8d69ac"
server_key_iv: "c23f50a7dbd450e8b0185e6817f198c6"
server_key_version: "encryptionkey@0"
I20260811 05:07:46.094496 12520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "3068169a851a4f03a9ab7b85e5ebf65e"
format_stamp: "Formatted at 2026-08-11 05:07:46 on dist-test-slave-w206"
server_key: "19e60620fd9af38348e8998f2b8d69ac"
server_key_iv: "c23f50a7dbd450e8b0185e6817f198c6"
server_key_version: "encryptionkey@0"
I20260811 05:07:46.098361 12520 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 05:07:46.100903 12537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:46.102195 12520 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:07:46.102375 12520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "3068169a851a4f03a9ab7b85e5ebf65e"
format_stamp: "Formatted at 2026-08-11 05:07:46 on dist-test-slave-w206"
server_key: "19e60620fd9af38348e8998f2b8d69ac"
server_key_iv: "c23f50a7dbd450e8b0185e6817f198c6"
server_key_version: "encryptionkey@0"
I20260811 05:07:46.102494 12520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:46.124966 12520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:46.128441 12520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:46.128662 12520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:46.136762 12520 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40069
I20260811 05:07:46.136823 12600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40069 every 8 connection(s)
I20260811 05:07:46.137809 12520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:46.140786 12601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:46.143684 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 12520
I20260811 05:07:46.143851 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:07:46.144237 22727 external_mini_cluster.cc:1428] Setting key 33cc2c0ad7b0d9a962c2b3a501a74386
I20260811 05:07:46.147958 12601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e: Bootstrap starting.
I20260811 05:07:46.150679 12601 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:46.151612 12601 log.cc:824] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e: Log is configured to *not* fsync() on all Append() calls
Aug 11 05:07:46 dist-test-slave-w206 krb5kdc[12506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 05:07:46.154276 12601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e: No bootstrap required, opened a new log
I20260811 05:07:46.157451 12601 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3068169a851a4f03a9ab7b85e5ebf65e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40069 } }
I20260811 05:07:46.157697 12601 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:46.157763 12601 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3068169a851a4f03a9ab7b85e5ebf65e, State: Initialized, Role: FOLLOWER
I20260811 05:07:46.158263 12601 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3068169a851a4f03a9ab7b85e5ebf65e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40069 } }
I20260811 05:07:46.158421 12601 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:46.158491 12601 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:46.158607 12601 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:46.160063 12601 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3068169a851a4f03a9ab7b85e5ebf65e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40069 } }
I20260811 05:07:46.160449 12601 leader_election.cc:302] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3068169a851a4f03a9ab7b85e5ebf65e; no voters:
I20260811 05:07:46.160828 12601 leader_election.cc:288] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:46.160967 12607 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:46.161176 12604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:46.145777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49197 (local address 127.0.0.1:40069)
0811 05:07:46.146222 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:46.146238 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:46.146316 (+ 78us) server_negotiation.cc:407] Connection header received
0811 05:07:46.147097 (+ 781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:46.147114 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:46.147475 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:46.147755 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:46.148822 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:46.149829 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:46.151109 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:46.151601 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:46.151726 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:46.154935 (+ 3209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:46.154941 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:46.154958 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:46.155049 (+ 91us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:46.157331 (+ 2282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:46.158047 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:46.158052 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:46.158057 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:46.158181 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:46.158601 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:46.158606 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:46.158608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:46.159203 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:46.159480 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:46.159796 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 05:07:46.160079 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":146,"threads_started":1}
I20260811 05:07:46.161234 12607 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [term 1 LEADER]: Becoming Leader. State: Replica: 3068169a851a4f03a9ab7b85e5ebf65e, State: Running, Role: LEADER
I20260811 05:07:46.161612 12607 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3068169a851a4f03a9ab7b85e5ebf65e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40069 } }
I20260811 05:07:46.162147 12601 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:46.164314 12608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3068169a851a4f03a9ab7b85e5ebf65e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3068169a851a4f03a9ab7b85e5ebf65e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40069 } } }
I20260811 05:07:46.164464 12608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:46.165753 12609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3068169a851a4f03a9ab7b85e5ebf65e. Latest consensus state: current_term: 1 leader_uuid: "3068169a851a4f03a9ab7b85e5ebf65e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3068169a851a4f03a9ab7b85e5ebf65e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40069 } } }
I20260811 05:07:46.165874 12609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:46.166114 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 05:07:46.168100 12622 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:07:46.168191 12622 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:07:46.168286 12624 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:46.169245 12624 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:46.176419 12624 catalog_manager.cc:1347] Generated new cluster ID: b8779ad2920f49d7af11279f5b2397df
I20260811 05:07:46.176497 12624 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:46.178261 12604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:46.168761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36931 (local address 127.0.0.1:40069)
0811 05:07:46.168903 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:46.168908 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:46.169183 (+ 275us) server_negotiation.cc:407] Connection header received
0811 05:07:46.169297 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:46.169300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:46.169362 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:46.169455 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:46.170341 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:46.171218 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:46.172359 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:46.172724 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:46.172838 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:46.174545 (+ 1707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:46.174549 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:46.174552 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:46.174577 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:46.176204 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:46.176776 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:46.176780 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:46.176782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:46.176879 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:46.177277 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:46.177281 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:46.177283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:46.177521 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:46.177694 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:46.177967 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 05:07:46.178081 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:07:46.184267 12624 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:46.185235 12624 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:46.197803 12624 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3068169a851a4f03a9ab7b85e5ebf65e: Generated new TSK 0
I20260811 05:07:46.198549 12624 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:07:46.204696 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 12520
W20260811 05:07:46.212930 12504 connection.cc:535] client connection to 127.0.0.1:40069 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40069): Connection reset by peer (error 104)
2026-08-11T05:07:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1510 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:46 dist-test-slave-w206 krb5kdc[12634](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:46 dist-test-slave-w206 krb5kdc[12634](info): set up 2 sockets
Aug 11 05:07:46 dist-test-slave-w206 krb5kdc[12634](info): commencing operation
krb5kdc: starting...
W20260811 05:07:47.298394 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:07:47 dist-test-slave-w206 krb5kdc[12634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:07:47.438802 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39821
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39821
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:47.560668 12647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:47.561048 12647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:47.561146 12647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:47.565303 12647 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:47.565429 12647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:47.565475 12647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:47.565541 12647 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:47.565582 12647 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:47.571288 12647 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39821
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:47.572497 12647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:47.573602 12647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:47.582713 12656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:47.582726 12654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:47.582726 12653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:47.582944 12647 server_base.cc:1034] running on GCE node
I20260811 05:07:47.583698 12647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:47.584843 12647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:47.586037 12647 hybrid_clock.cc:648] HybridClock initialized: now 1786424867586016 us; error 42 us; skew 500 ppm
Aug 11 05:07:47 dist-test-slave-w206 krb5kdc[12634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424867, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:47.589008 12647 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:07:47.589921 12647 webserver.cc:460] Webserver started at http://127.0.0.1:38841/ using document root <none> and password file <none>
I20260811 05:07:47.590483 12647 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:47.590575 12647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:47.590806 12647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:47.592918 12647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "bd63e08b96914722a2be94a7865a3518"
format_stamp: "Formatted at 2026-08-11 05:07:47 on dist-test-slave-w206"
server_key: "39215ed38bcaa8d6fbdb8ecdb806f0ca"
server_key_iv: "920adf0d7a3689c4c652b3811d2f934b"
server_key_version: "encryptionkey@0"
I20260811 05:07:47.593501 12647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "bd63e08b96914722a2be94a7865a3518"
format_stamp: "Formatted at 2026-08-11 05:07:47 on dist-test-slave-w206"
server_key: "39215ed38bcaa8d6fbdb8ecdb806f0ca"
server_key_iv: "920adf0d7a3689c4c652b3811d2f934b"
server_key_version: "encryptionkey@0"
I20260811 05:07:47.597419 12647 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:07:47.599877 12665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:47.601182 12647 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:07:47.601331 12647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "bd63e08b96914722a2be94a7865a3518"
format_stamp: "Formatted at 2026-08-11 05:07:47 on dist-test-slave-w206"
server_key: "39215ed38bcaa8d6fbdb8ecdb806f0ca"
server_key_iv: "920adf0d7a3689c4c652b3811d2f934b"
server_key_version: "encryptionkey@0"
I20260811 05:07:47.601449 12647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:47.618898 12647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:47.622114 12647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:47.622334 12647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:47.630044 12647 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39821
I20260811 05:07:47.630074 12724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39821 every 8 connection(s)
I20260811 05:07:47.631032 12647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:47.634183 12725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:47.637387 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 12647
I20260811 05:07:47.637506 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:07:47.637820 22727 external_mini_cluster.cc:1428] Setting key 130b74f9a1e082fcd1f1a4e7922cdae0
I20260811 05:07:47.640921 12725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518: Bootstrap starting.
I20260811 05:07:47.643894 12725 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:47.644757 12725 log.cc:824] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:47.647089 12725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518: No bootstrap required, opened a new log
I20260811 05:07:47.648805 12729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:47.639282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47851 (local address 127.0.0.1:39821)
0811 05:07:47.639743 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:47.639765 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:47.639814 (+ 49us) server_negotiation.cc:407] Connection header received
0811 05:07:47.640762 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:47.640787 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:47.641259 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:47.641629 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:47.642073 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:47.643820 (+ 1747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:47.644857 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:47.645502 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:47.645716 (+ 214us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:47.646611 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:47.646618 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:47.646634 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:47.647223 (+ 589us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:47.647296 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:47.647328 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:47.647484 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:47.647694 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 05:07:47.647838 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":124,"threads_started":1}
I20260811 05:07:47.652170 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:07:47.652104 12725 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd63e08b96914722a2be94a7865a3518" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39821 } }
I20260811 05:07:47.652354 12725 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:47.652428 12725 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd63e08b96914722a2be94a7865a3518, State: Initialized, Role: FOLLOWER
I20260811 05:07:47.652923 12725 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd63e08b96914722a2be94a7865a3518" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39821 } }
I20260811 05:07:47.653056 12725 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:47.653149 12725 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:47.653272 12725 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:47.654412 12725 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd63e08b96914722a2be94a7865a3518" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39821 } }
I20260811 05:07:47.654852 12725 leader_election.cc:302] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd63e08b96914722a2be94a7865a3518; no voters:
I20260811 05:07:47.655256 12725 leader_election.cc:288] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:47.655435 12737 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:47.655663 12737 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [term 1 LEADER]: Becoming Leader. State: Replica: bd63e08b96914722a2be94a7865a3518, State: Running, Role: LEADER
I20260811 05:07:47.656052 12737 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd63e08b96914722a2be94a7865a3518" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39821 } }
I20260811 05:07:47.656669 12725 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:47.657226 12737 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd63e08b96914722a2be94a7865a3518. Latest consensus state: current_term: 1 leader_uuid: "bd63e08b96914722a2be94a7865a3518" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd63e08b96914722a2be94a7865a3518" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39821 } } }
I20260811 05:07:47.657423 12737 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:47.657877 12743 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:47.659807 12738 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd63e08b96914722a2be94a7865a3518" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd63e08b96914722a2be94a7865a3518" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39821 } } }
I20260811 05:07:47.660012 12738 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:47.660153 12729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:47.654441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52599 (local address 127.0.0.1:39821)
0811 05:07:47.654577 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:47.654581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:47.654804 (+ 223us) server_negotiation.cc:407] Connection header received
0811 05:07:47.654942 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:47.654945 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:47.655028 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:47.655114 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:47.655490 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:47.656273 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:47.657529 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:47.657947 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:47.658063 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:47.659284 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:47.659290 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:47.659293 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:47.659310 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:47.659352 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:47.659368 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:47.659482 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:47.659763 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 05:07:47.659809 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:07:47.661772 12743 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:47.667368 12743 catalog_manager.cc:1347] Generated new cluster ID: bcaa0ac453064bebad83c6bbb0b3d16c
I20260811 05:07:47.667439 12743 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:47.686400 12743 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:47.687836 12743 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:47.696565 12743 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd63e08b96914722a2be94a7865a3518: Generated new TSK 0
I20260811 05:07:47.697453 12743 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:07:47.704533 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 12647
W20260811 05:07:47.712453 12632 connection.cc:535] client connection to 127.0.0.1:39821 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39821): Connection reset by peer (error 104)
2026-08-11T05:07:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1499 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:47 dist-test-slave-w206 krb5kdc[12758](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:47 dist-test-slave-w206 krb5kdc[12758](info): set up 2 sockets
Aug 11 05:07:47 dist-test-slave-w206 krb5kdc[12758](info): commencing operation
krb5kdc: starting...
W20260811 05:07:49.090828 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.363s user 0.003s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:07:49 dist-test-slave-w206 krb5kdc[12758](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:07:49.230458 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34507
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34507
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:49.343184 12774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:49.343528 12774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:49.343613 12774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:49.347724 12774 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:49.347831 12774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:49.347868 12774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:49.347905 12774 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:49.347937 12774 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:49.353777 12774 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34507
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:49.355082 12774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:49.356202 12774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:49.365132 12779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:49.365155 12782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:49.365147 12780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:49.365439 12774 server_base.cc:1034] running on GCE node
I20260811 05:07:49.366138 12774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:49.367370 12774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:49.368558 12774 hybrid_clock.cc:648] HybridClock initialized: now 1786424869368538 us; error 32 us; skew 500 ppm
Aug 11 05:07:49 dist-test-slave-w206 krb5kdc[12758](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424869, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:49.371357 12774 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:07:49.372304 12774 webserver.cc:460] Webserver started at http://127.0.0.1:35831/ using document root <none> and password file <none>
I20260811 05:07:49.372867 12774 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:49.372970 12774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:49.373220 12774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:49.375380 12774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "7603da2a7bd84da5bbebe1da64dd4a8b"
format_stamp: "Formatted at 2026-08-11 05:07:49 on dist-test-slave-w206"
server_key: "0e1f5dc1fa3fdd12a91fc38b9fada0c9"
server_key_iv: "d3cdee909660a38c668d5a1062dccdce"
server_key_version: "encryptionkey@0"
I20260811 05:07:49.375988 12774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "7603da2a7bd84da5bbebe1da64dd4a8b"
format_stamp: "Formatted at 2026-08-11 05:07:49 on dist-test-slave-w206"
server_key: "0e1f5dc1fa3fdd12a91fc38b9fada0c9"
server_key_iv: "d3cdee909660a38c668d5a1062dccdce"
server_key_version: "encryptionkey@0"
I20260811 05:07:49.379885 12774 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 05:07:49.382321 12789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:49.383620 12774 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:07:49.383767 12774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "7603da2a7bd84da5bbebe1da64dd4a8b"
format_stamp: "Formatted at 2026-08-11 05:07:49 on dist-test-slave-w206"
server_key: "0e1f5dc1fa3fdd12a91fc38b9fada0c9"
server_key_iv: "d3cdee909660a38c668d5a1062dccdce"
server_key_version: "encryptionkey@0"
I20260811 05:07:49.383884 12774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:49.388705 12774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:49.391724 12774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:49.391932 12774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:49.399544 12774 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34507
I20260811 05:07:49.399561 12849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34507 every 8 connection(s)
I20260811 05:07:49.400581 12774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:49.403388 12850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:49.407672 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 12774
I20260811 05:07:49.407833 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:07:49.408141 22727 external_mini_cluster.cc:1428] Setting key 243577ebd015f7388335e9a1b5878ae3
I20260811 05:07:49.409263 12850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b: Bootstrap starting.
I20260811 05:07:49.412074 12850 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:49.412910 12850 log.cc:824] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:49.414108 12853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:49.409610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35651 (local address 127.0.0.1:34507)
0811 05:07:49.410142 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:49.410168 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:49.410225 (+ 57us) server_negotiation.cc:407] Connection header received
0811 05:07:49.411279 (+ 1054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:49.411301 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:49.411604 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:49.411884 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:49.412722 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:49.412728 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:49.412750 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:49.412762 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:49.412819 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:49.412838 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:49.412962 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:49.413072 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 05:07:49.413229 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":141,"threads_started":1}
I20260811 05:07:49.415175 12850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b: No bootstrap required, opened a new log
I20260811 05:07:49.416930 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:07:49.419122 12850 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7603da2a7bd84da5bbebe1da64dd4a8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34507 } }
I20260811 05:07:49.419427 12850 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:49.419497 12850 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7603da2a7bd84da5bbebe1da64dd4a8b, State: Initialized, Role: FOLLOWER
I20260811 05:07:49.419976 12850 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7603da2a7bd84da5bbebe1da64dd4a8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34507 } }
I20260811 05:07:49.420163 12850 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:49.420246 12850 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:49.420351 12850 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:49.420930 12853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:49.419153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33557 (local address 127.0.0.1:34507)
0811 05:07:49.419293 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:49.419298 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:49.419606 (+ 308us) server_negotiation.cc:407] Connection header received
0811 05:07:49.419644 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:49.419647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:49.419681 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:49.419757 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:49.420582 (+ 825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:49.420588 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:49.420594 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:49.420609 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:49.420638 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:49.420650 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:49.420747 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:49.420784 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 05:07:49.420819 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 05:07:49.421473 12850 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7603da2a7bd84da5bbebe1da64dd4a8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34507 } }
I20260811 05:07:49.421800 12850 leader_election.cc:302] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7603da2a7bd84da5bbebe1da64dd4a8b; no voters:
I20260811 05:07:49.422093 12850 leader_election.cc:288] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:49.422219 12860 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:49.422472 12860 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [term 1 LEADER]: Becoming Leader. State: Replica: 7603da2a7bd84da5bbebe1da64dd4a8b, State: Running, Role: LEADER
I20260811 05:07:49.422801 12860 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7603da2a7bd84da5bbebe1da64dd4a8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34507 } }
I20260811 05:07:49.423249 12850 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:49.424613 12862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7603da2a7bd84da5bbebe1da64dd4a8b. Latest consensus state: current_term: 1 leader_uuid: "7603da2a7bd84da5bbebe1da64dd4a8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7603da2a7bd84da5bbebe1da64dd4a8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34507 } } }
I20260811 05:07:49.424657 12861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7603da2a7bd84da5bbebe1da64dd4a8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7603da2a7bd84da5bbebe1da64dd4a8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34507 } } }
I20260811 05:07:49.424782 12862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:49.424783 12861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:49.425189 12872 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:49.428347 12872 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:49.433511 12872 catalog_manager.cc:1347] Generated new cluster ID: c3bd57161a8d43cbb1376b30919e3202
I20260811 05:07:49.433589 12872 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:49.452790 12872 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:49.453147 12872 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:49.469175 12872 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7603da2a7bd84da5bbebe1da64dd4a8b: Generated new TSK 0
I20260811 05:07:49.469928 12872 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:07:49.476500 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 12774
2026-08-11T05:07:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1770 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:49 dist-test-slave-w206 krb5kdc[12882](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:49 dist-test-slave-w206 krb5kdc[12882](info): set up 2 sockets
Aug 11 05:07:49 dist-test-slave-w206 krb5kdc[12882](info): commencing operation
krb5kdc: starting...
W20260811 05:07:50.634684 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.008s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:07:50 dist-test-slave-w206 krb5kdc[12882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:07:50.773922 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46395
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46395
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:50.887647 12895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:50.887959 12895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:50.888036 12895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:50.892091 12895 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:50.892180 12895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:50.892217 12895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:50.892277 12895 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:50.892325 12895 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:50.897593 12895 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:50.898697 12895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:50.899777 12895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:50.908622 12901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:50.908871 12895 server_base.cc:1034] running on GCE node
W20260811 05:07:50.908694 12904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:50.908622 12900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:50.909576 12895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:50.910693 12895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:50.911887 12895 hybrid_clock.cc:648] HybridClock initialized: now 1786424870911867 us; error 35 us; skew 500 ppm
Aug 11 05:07:50 dist-test-slave-w206 krb5kdc[12882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424870, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:50.914822 12895 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:07:50.915779 12895 webserver.cc:460] Webserver started at http://127.0.0.1:44737/ using document root <none> and password file <none>
I20260811 05:07:50.916285 12895 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:50.916348 12895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:50.916514 12895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:50.918533 12895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "65a75287b6d54345bf081d2f77b7a1e3"
format_stamp: "Formatted at 2026-08-11 05:07:50 on dist-test-slave-w206"
server_key: "8cb86707f2055f7dc20f29ce9d3fb8b5"
server_key_iv: "8caa2e011fd0d69d7900226b37b71cd7"
server_key_version: "encryptionkey@0"
I20260811 05:07:50.919116 12895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "65a75287b6d54345bf081d2f77b7a1e3"
format_stamp: "Formatted at 2026-08-11 05:07:50 on dist-test-slave-w206"
server_key: "8cb86707f2055f7dc20f29ce9d3fb8b5"
server_key_iv: "8caa2e011fd0d69d7900226b37b71cd7"
server_key_version: "encryptionkey@0"
I20260811 05:07:50.922752 12895 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 05:07:50.925086 12912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:50.926255 12895 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:07:50.926371 12895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "65a75287b6d54345bf081d2f77b7a1e3"
format_stamp: "Formatted at 2026-08-11 05:07:50 on dist-test-slave-w206"
server_key: "8cb86707f2055f7dc20f29ce9d3fb8b5"
server_key_iv: "8caa2e011fd0d69d7900226b37b71cd7"
server_key_version: "encryptionkey@0"
I20260811 05:07:50.926465 12895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:50.957646 12895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:50.961042 12895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:50.961205 12895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:50.968743 12895 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46395
I20260811 05:07:50.968772 12978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46395 every 8 connection(s)
I20260811 05:07:50.969709 12895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:50.971783 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 12895
I20260811 05:07:50.971958 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:07:50.972352 22727 external_mini_cluster.cc:1428] Setting key a6924d2dd82f7557e82503e4b715929f
I20260811 05:07:50.972584 12980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:50.979508 12980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3: Bootstrap starting.
I20260811 05:07:50.981670 12980 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3: Neither blocks nor log segments found. Creating new log.
Aug 11 05:07:50 dist-test-slave-w206 krb5kdc[12882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 05:07:50.982573 12980 log.cc:824] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:50.984788 12980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3: No bootstrap required, opened a new log
I20260811 05:07:50.987612 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:50.973930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36415 (local address 127.0.0.1:46395)
0811 05:07:50.974412 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:50.974434 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:50.974471 (+ 37us) server_negotiation.cc:407] Connection header received
0811 05:07:50.975242 (+ 771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:50.975260 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:50.975632 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:50.975907 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:50.976877 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:50.977886 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:50.979077 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:50.979544 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:50.979729 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:50.982415 (+ 2686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:50.982420 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:50.982432 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:50.982460 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:50.984447 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:50.984892 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:50.984898 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:50.984904 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:50.985055 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:50.985357 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:50.985361 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:50.985362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:50.985847 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:50.986034 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:50.986267 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 05:07:50.986566 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":161,"threads_started":1}
I20260811 05:07:50.989405 12980 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65a75287b6d54345bf081d2f77b7a1e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46395 } }
I20260811 05:07:50.989681 12980 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:50.989771 12980 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65a75287b6d54345bf081d2f77b7a1e3, State: Initialized, Role: FOLLOWER
I20260811 05:07:50.990216 12980 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65a75287b6d54345bf081d2f77b7a1e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46395 } }
I20260811 05:07:50.990373 12980 raft_consensus.cc:388] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:50.990465 12980 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:50.990540 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:07:50.990574 12980 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:50.991801 12980 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65a75287b6d54345bf081d2f77b7a1e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46395 } }
I20260811 05:07:50.992210 12980 leader_election.cc:302] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65a75287b6d54345bf081d2f77b7a1e3; no voters:
I20260811 05:07:50.992542 12980 leader_election.cc:288] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:50.992667 12991 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:50.992969 12991 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 65a75287b6d54345bf081d2f77b7a1e3, State: Running, Role: LEADER
I20260811 05:07:50.993463 12991 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65a75287b6d54345bf081d2f77b7a1e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46395 } }
I20260811 05:07:50.993878 12980 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:50.994791 12991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65a75287b6d54345bf081d2f77b7a1e3. Latest consensus state: current_term: 1 leader_uuid: "65a75287b6d54345bf081d2f77b7a1e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65a75287b6d54345bf081d2f77b7a1e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46395 } } }
I20260811 05:07:50.994913 12991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:50.996198 12992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65a75287b6d54345bf081d2f77b7a1e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65a75287b6d54345bf081d2f77b7a1e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46395 } } }
I20260811 05:07:50.997852 12992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3 [sys.catalog]: This master's current role is: LEADER
W20260811 05:07:50.999018 13009 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:07:50.999099 13009 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:07:50.999397 13001 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:51.000137 13001 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:51.003147 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:50.993024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59635 (local address 127.0.0.1:46395)
0811 05:07:50.993126 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:50.993131 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:50.993462 (+ 331us) server_negotiation.cc:407] Connection header received
0811 05:07:50.993590 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:50.993593 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:50.993641 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:50.993720 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:50.994659 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:50.995584 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:50.997122 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:50.997510 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:50.997647 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:50.999269 (+ 1622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:50.999273 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:50.999276 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:50.999304 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:51.001304 (+ 2000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:51.001804 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:51.001809 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:51.001810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:51.001912 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:51.002203 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:51.002207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:51.002209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:51.002459 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:51.002596 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:51.002815 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 05:07:51.002941 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 05:07:51.006139 13001 catalog_manager.cc:1347] Generated new cluster ID: c06f2cba492044d4b5b4541385b5cef5
I20260811 05:07:51.006206 13001 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:51.020427 13001 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:51.021380 13001 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:51.025583 13001 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65a75287b6d54345bf081d2f77b7a1e3: Generated new TSK 0
I20260811 05:07:51.026302 13001 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:07:51.030778 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 12895
2026-08-11T05:07:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1555 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:51 dist-test-slave-w206 krb5kdc[13015](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:51 dist-test-slave-w206 krb5kdc[13015](info): set up 2 sockets
Aug 11 05:07:51 dist-test-slave-w206 krb5kdc[13015](info): commencing operation
krb5kdc: starting...
W20260811 05:07:52.132335 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:07:52 dist-test-slave-w206 krb5kdc[13015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:07:52.271665 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36005
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36005
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:52.386961 13030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:52.387245 13030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:52.387295 13030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:52.391299 13030 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:52.391359 13030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:52.391378 13030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:52.391394 13030 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:52.391410 13030 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:52.396735 13030 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36005
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:52.397809 13030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:52.398854 13030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:52.407717 13038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:52.407717 13040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:52.407755 13037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:52.407936 13030 server_base.cc:1034] running on GCE node
I20260811 05:07:52.408629 13030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:52.409722 13030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:52.410897 13030 hybrid_clock.cc:648] HybridClock initialized: now 1786424872410881 us; error 28 us; skew 500 ppm
Aug 11 05:07:52 dist-test-slave-w206 krb5kdc[13015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424872, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:52.418282 13030 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:07:52.419406 13030 webserver.cc:460] Webserver started at http://127.0.0.1:46177/ using document root <none> and password file <none>
I20260811 05:07:52.419996 13030 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:52.420059 13030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:52.420316 13030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:52.422438 13030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "244b1843aa3948fa8d1cc9dfdad33413"
format_stamp: "Formatted at 2026-08-11 05:07:52 on dist-test-slave-w206"
server_key: "d93660989fac97cd2c53b4bcefd2c24e"
server_key_iv: "e3681437d4ff5d4e9bfafee005adc0eb"
server_key_version: "encryptionkey@0"
I20260811 05:07:52.423066 13030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "244b1843aa3948fa8d1cc9dfdad33413"
format_stamp: "Formatted at 2026-08-11 05:07:52 on dist-test-slave-w206"
server_key: "d93660989fac97cd2c53b4bcefd2c24e"
server_key_iv: "e3681437d4ff5d4e9bfafee005adc0eb"
server_key_version: "encryptionkey@0"
I20260811 05:07:52.426796 13030 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:52.429364 13048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:52.430612 13030 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:07:52.430761 13030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "244b1843aa3948fa8d1cc9dfdad33413"
format_stamp: "Formatted at 2026-08-11 05:07:52 on dist-test-slave-w206"
server_key: "d93660989fac97cd2c53b4bcefd2c24e"
server_key_iv: "e3681437d4ff5d4e9bfafee005adc0eb"
server_key_version: "encryptionkey@0"
I20260811 05:07:52.430872 13030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:52.442377 13030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:52.445684 13030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:52.445894 13030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:52.452961 13030 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36005
I20260811 05:07:52.453037 13106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36005 every 8 connection(s)
I20260811 05:07:52.453954 13030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:52.456735 13107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:52.459477 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 13030
I20260811 05:07:52.459628 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:07:52.459956 22727 external_mini_cluster.cc:1428] Setting key f31c4ab2b586bde706799e96c5f8e864
I20260811 05:07:52.463136 13107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413: Bootstrap starting.
I20260811 05:07:52.465703 13107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:52.466570 13107 log.cc:824] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:52.468719 13107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413: No bootstrap required, opened a new log
I20260811 05:07:52.469085 13111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:52.461322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44331 (local address 127.0.0.1:36005)
0811 05:07:52.461756 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:52.461781 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:52.461843 (+ 62us) server_negotiation.cc:407] Connection header received
0811 05:07:52.462483 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:52.462499 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:52.462828 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:52.463187 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:52.463572 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:52.464515 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:52.465724 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:52.466227 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:52.466344 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:52.467276 (+ 932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:52.467283 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:52.467301 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:52.467752 (+ 451us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:52.467805 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:52.467828 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:52.467907 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:52.468077 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 05:07:52.468301 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":136,"threads_started":1}
I20260811 05:07:52.471860 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:07:52.472517 13107 raft_consensus.cc:348] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "244b1843aa3948fa8d1cc9dfdad33413" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36005 } }
I20260811 05:07:52.472815 13107 raft_consensus.cc:374] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:52.472890 13107 raft_consensus.cc:729] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b1843aa3948fa8d1cc9dfdad33413, State: Initialized, Role: FOLLOWER
I20260811 05:07:52.473382 13107 consensus_queue.cc:260] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "244b1843aa3948fa8d1cc9dfdad33413" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36005 } }
I20260811 05:07:52.473554 13107 raft_consensus.cc:388] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:52.473628 13107 raft_consensus.cc:482] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:52.473728 13107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:52.475096 13107 raft_consensus.cc:504] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "244b1843aa3948fa8d1cc9dfdad33413" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36005 } }
I20260811 05:07:52.475452 13107 leader_election.cc:302] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 244b1843aa3948fa8d1cc9dfdad33413; no voters:
I20260811 05:07:52.475760 13107 leader_election.cc:288] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:52.475891 13120 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:52.476112 13120 raft_consensus.cc:686] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [term 1 LEADER]: Becoming Leader. State: Replica: 244b1843aa3948fa8d1cc9dfdad33413, State: Running, Role: LEADER
I20260811 05:07:52.476447 13120 consensus_queue.cc:237] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "244b1843aa3948fa8d1cc9dfdad33413" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36005 } }
I20260811 05:07:52.477098 13107 sys_catalog.cc:564] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:52.477653 13120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 244b1843aa3948fa8d1cc9dfdad33413. Latest consensus state: current_term: 1 leader_uuid: "244b1843aa3948fa8d1cc9dfdad33413" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "244b1843aa3948fa8d1cc9dfdad33413" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36005 } } }
I20260811 05:07:52.478454 13120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:52.478338 13121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "244b1843aa3948fa8d1cc9dfdad33413" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "244b1843aa3948fa8d1cc9dfdad33413" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36005 } } }
I20260811 05:07:52.478901 13111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:52.474208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40035 (local address 127.0.0.1:36005)
0811 05:07:52.474327 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:52.474331 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:52.474484 (+ 153us) server_negotiation.cc:407] Connection header received
0811 05:07:52.474592 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:52.474594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:52.474630 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:52.474692 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:52.475069 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:52.475717 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:52.476808 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:52.477131 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:52.477229 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:52.478326 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:52.478332 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:52.478336 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:52.478350 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:52.478392 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:52.478406 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:52.478456 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:52.478652 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 05:07:52.478714 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 05:07:52.478802 13121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413 [sys.catalog]: This master's current role is: LEADER
W20260811 05:07:52.481958 13136 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:07:52.482051 13136 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:07:52.482131 13131 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:52.482844 13131 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:52.488498 13131 catalog_manager.cc:1347] Generated new cluster ID: f6e7ef97c55f4613a7183f0f12bc1cd0
I20260811 05:07:52.488571 13131 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:52.511787 13131 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:52.512837 13131 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:52.517987 13131 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 244b1843aa3948fa8d1cc9dfdad33413: Generated new TSK 0
I20260811 05:07:52.518839 13131 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:07:52.523180 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 13030
2026-08-11T05:07:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1493 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:52 dist-test-slave-w206 krb5kdc[13142](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:52 dist-test-slave-w206 krb5kdc[13142](info): set up 2 sockets
Aug 11 05:07:52 dist-test-slave-w206 krb5kdc[13142](info): commencing operation
krb5kdc: starting...
W20260811 05:07:53.615983 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:07:53 dist-test-slave-w206 krb5kdc[13142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:07:53.747965 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39507
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39507
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:53.863343 13155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:53.863711 13155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:53.863811 13155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:53.868059 13155 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:53.868170 13155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:53.868214 13155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:53.868281 13155 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:53.868314 13155 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:53.873754 13155 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39507
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13155
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:53.874941 13155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:53.876040 13155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:53.884639 13160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:53.884752 13161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:53.884670 13163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:53.884866 13155 server_base.cc:1034] running on GCE node
I20260811 05:07:53.885496 13155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:53.886605 13155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:53.887820 13155 hybrid_clock.cc:648] HybridClock initialized: now 1786424873887801 us; error 34 us; skew 500 ppm
Aug 11 05:07:53 dist-test-slave-w206 krb5kdc[13142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424873, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:53.890599 13155 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:07:53.891579 13155 webserver.cc:460] Webserver started at http://127.0.0.1:42783/ using document root <none> and password file <none>
I20260811 05:07:53.892139 13155 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:53.892232 13155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:53.892467 13155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:53.894516 13155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "b1b23cddfcc9445295e35da666cde760"
format_stamp: "Formatted at 2026-08-11 05:07:53 on dist-test-slave-w206"
server_key: "e55967fb1c628208cf2992ac47688c0e"
server_key_iv: "7c683c0a1ad9f385d02e00f38209a224"
server_key_version: "encryptionkey@0"
I20260811 05:07:53.895152 13155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "b1b23cddfcc9445295e35da666cde760"
format_stamp: "Formatted at 2026-08-11 05:07:53 on dist-test-slave-w206"
server_key: "e55967fb1c628208cf2992ac47688c0e"
server_key_iv: "7c683c0a1ad9f385d02e00f38209a224"
server_key_version: "encryptionkey@0"
I20260811 05:07:53.898743 13155 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:07:53.901152 13171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:53.902401 13155 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:07:53.902544 13155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "b1b23cddfcc9445295e35da666cde760"
format_stamp: "Formatted at 2026-08-11 05:07:53 on dist-test-slave-w206"
server_key: "e55967fb1c628208cf2992ac47688c0e"
server_key_iv: "7c683c0a1ad9f385d02e00f38209a224"
server_key_version: "encryptionkey@0"
I20260811 05:07:53.902654 13155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:53.907507 13155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:53.910665 13155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:53.910872 13155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:53.918315 13155 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39507
I20260811 05:07:53.918394 13228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39507 every 8 connection(s)
I20260811 05:07:53.919308 13155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:53.922112 13229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:53.925069 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 13155
I20260811 05:07:53.925230 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:07:53.925539 22727 external_mini_cluster.cc:1428] Setting key cf734dd13648a822e503b8866d42a624
I20260811 05:07:53.928546 13229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760: Bootstrap starting.
I20260811 05:07:53.931120 13232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:53.926951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53601 (local address 127.0.0.1:39507)
0811 05:07:53.927454 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:53.927474 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:53.927518 (+ 44us) server_negotiation.cc:407] Connection header received
0811 05:07:53.928322 (+ 804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:53.928344 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:53.928686 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:53.929042 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:53.929771 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:53.929779 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:53.929796 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:53.929808 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:53.929873 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:53.929903 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:53.930041 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:53.930108 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 05:07:53.930249 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":129,"threads_started":1}
I20260811 05:07:53.931281 13229 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:53.932140 13229 log.cc:824] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:53.934038 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:07:53.934482 13229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760: No bootstrap required, opened a new log
I20260811 05:07:53.938227 13232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:53.936194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60181 (local address 127.0.0.1:39507)
0811 05:07:53.936325 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:53.936329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:53.936546 (+ 217us) server_negotiation.cc:407] Connection header received
0811 05:07:53.936664 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:53.936666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:53.936693 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:53.936756 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:53.937773 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:53.937776 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:53.937778 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:53.937788 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:53.937812 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:53.937822 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:53.937896 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:53.938042 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 05:07:53.938075 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:07:53.939489 13229 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1b23cddfcc9445295e35da666cde760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39507 } }
I20260811 05:07:53.939754 13229 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:53.939821 13229 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1b23cddfcc9445295e35da666cde760, State: Initialized, Role: FOLLOWER
I20260811 05:07:53.940335 13229 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1b23cddfcc9445295e35da666cde760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39507 } }
I20260811 05:07:53.940549 13229 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:53.940644 13229 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:53.940754 13229 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:53.941978 13229 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1b23cddfcc9445295e35da666cde760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39507 } }
I20260811 05:07:53.942379 13229 leader_election.cc:302] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1b23cddfcc9445295e35da666cde760; no voters:
I20260811 05:07:53.942777 13229 leader_election.cc:288] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:53.942911 13240 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:53.943207 13240 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [term 1 LEADER]: Becoming Leader. State: Replica: b1b23cddfcc9445295e35da666cde760, State: Running, Role: LEADER
I20260811 05:07:53.943578 13240 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1b23cddfcc9445295e35da666cde760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39507 } }
I20260811 05:07:53.944147 13229 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:53.945351 13241 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1b23cddfcc9445295e35da666cde760" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1b23cddfcc9445295e35da666cde760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39507 } } }
I20260811 05:07:53.945490 13241 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:53.945361 13242 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1b23cddfcc9445295e35da666cde760. Latest consensus state: current_term: 1 leader_uuid: "b1b23cddfcc9445295e35da666cde760" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1b23cddfcc9445295e35da666cde760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39507 } } }
I20260811 05:07:53.945883 13250 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:53.945935 13242 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:53.949211 13250 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:53.955116 13250 catalog_manager.cc:1347] Generated new cluster ID: b147db13923946ef8b03dceda96342a3
I20260811 05:07:53.955201 13250 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:53.975426 13250 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:53.975775 13250 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:53.989147 13250 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1b23cddfcc9445295e35da666cde760: Generated new TSK 0
I20260811 05:07:53.989959 13250 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:07:53.996678 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 13155
2026-08-11T05:07:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1472 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:54 dist-test-slave-w206 krb5kdc[13263](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:54 dist-test-slave-w206 krb5kdc[13263](info): set up 2 sockets
Aug 11 05:07:54 dist-test-slave-w206 krb5kdc[13263](info): commencing operation
krb5kdc: starting...
W20260811 05:07:55.164583 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:07:55 dist-test-slave-w206 krb5kdc[13263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:07:55.297907 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37893
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:55.412169 13281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:55.412516 13281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:55.412596 13281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:55.416688 13281 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:55.416797 13281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:55.416846 13281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:55.416882 13281 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:55.416918 13281 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:55.422200 13281 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:55.423353 13281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:55.424407 13281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:55.433174 13289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:55.433174 13287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:55.433190 13286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:55.433633 13281 server_base.cc:1034] running on GCE node
I20260811 05:07:55.434280 13281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:55.435559 13281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:55.436779 13281 hybrid_clock.cc:648] HybridClock initialized: now 1786424875436760 us; error 32 us; skew 500 ppm
Aug 11 05:07:55 dist-test-slave-w206 krb5kdc[13263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424875, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:55.440106 13281 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:07:55.441107 13281 webserver.cc:460] Webserver started at http://127.0.0.1:45673/ using document root <none> and password file <none>
I20260811 05:07:55.441717 13281 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:55.441788 13281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:55.442028 13281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:55.444315 13281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "6373086bf6324d728c1b9c666bc87494"
format_stamp: "Formatted at 2026-08-11 05:07:55 on dist-test-slave-w206"
server_key: "899fbfeb3348d2fde9dca068d022c973"
server_key_iv: "835597027679f81d399d0a4c29591f4b"
server_key_version: "encryptionkey@0"
I20260811 05:07:55.444939 13281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "6373086bf6324d728c1b9c666bc87494"
format_stamp: "Formatted at 2026-08-11 05:07:55 on dist-test-slave-w206"
server_key: "899fbfeb3348d2fde9dca068d022c973"
server_key_iv: "835597027679f81d399d0a4c29591f4b"
server_key_version: "encryptionkey@0"
I20260811 05:07:55.448918 13281 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:07:55.451535 13296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:55.452817 13281 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:07:55.452963 13281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "6373086bf6324d728c1b9c666bc87494"
format_stamp: "Formatted at 2026-08-11 05:07:55 on dist-test-slave-w206"
server_key: "899fbfeb3348d2fde9dca068d022c973"
server_key_iv: "835597027679f81d399d0a4c29591f4b"
server_key_version: "encryptionkey@0"
I20260811 05:07:55.453073 13281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:55.481902 13281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:55.485809 13281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:55.486055 13281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:55.494367 13281 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37893
I20260811 05:07:55.494408 13352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37893 every 8 connection(s)
I20260811 05:07:55.495473 13281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:55.498339 13353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:55.503868 13353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494: Bootstrap starting.
I20260811 05:07:55.505788 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 13281
I20260811 05:07:55.505944 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:07:55.506234 22727 external_mini_cluster.cc:1428] Setting key a3b595c11962f8d7c3f68a42fa08e359
I20260811 05:07:55.506615 13353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:55.507575 13353 log.cc:824] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:55.509634 13353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494: No bootstrap required, opened a new log
I20260811 05:07:55.514010 13353 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6373086bf6324d728c1b9c666bc87494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37893 } }
I20260811 05:07:55.514326 13353 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:55.514400 13353 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6373086bf6324d728c1b9c666bc87494, State: Initialized, Role: FOLLOWER
I20260811 05:07:55.514943 13353 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6373086bf6324d728c1b9c666bc87494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37893 } }
I20260811 05:07:55.515123 13353 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:55.515216 13353 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:55.515317 13353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 05:07:55 dist-test-slave-w206 krb5kdc[13263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 05:07:55.516324 13353 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6373086bf6324d728c1b9c666bc87494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37893 } }
I20260811 05:07:55.516669 13353 leader_election.cc:302] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6373086bf6324d728c1b9c666bc87494; no voters:
I20260811 05:07:55.516999 13353 leader_election.cc:288] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:55.517132 13358 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:55.517684 13358 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [term 1 LEADER]: Becoming Leader. State: Replica: 6373086bf6324d728c1b9c666bc87494, State: Running, Role: LEADER
I20260811 05:07:55.518078 13358 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6373086bf6324d728c1b9c666bc87494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37893 } }
I20260811 05:07:55.518311 13353 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:55.520133 13359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6373086bf6324d728c1b9c666bc87494" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6373086bf6324d728c1b9c666bc87494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37893 } } }
I20260811 05:07:55.520146 13360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6373086bf6324d728c1b9c666bc87494. Latest consensus state: current_term: 1 leader_uuid: "6373086bf6324d728c1b9c666bc87494" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6373086bf6324d728c1b9c666bc87494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37893 } } }
I20260811 05:07:55.520267 13359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:55.520272 13360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:55.520788 13369 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:55.522432 13356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:55.507582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:52577 (local address 127.0.0.1:37893)
0811 05:07:55.508056 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:55.508078 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:55.508113 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:07:55.508772 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:55.508789 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:55.509127 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:55.509400 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:55.510325 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:55.511359 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:55.512594 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:55.513067 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:55.513183 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:55.516283 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:55.516289 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:55.516302 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:55.516331 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:55.518604 (+ 2273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:55.519266 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:55.519272 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:55.519278 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:55.519426 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:55.519995 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:55.520001 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:55.520002 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:55.520575 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:55.520788 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:55.521433 (+ 645us) server_negotiation.cc:299] Negotiation successful
0811 05:07:55.521653 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":325,"thread_start_us":155,"threads_started":1}
I20260811 05:07:55.524420 13369 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:55.526023 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:07:55.530371 13369 catalog_manager.cc:1347] Generated new cluster ID: 9ccb5ea7f0ae4fbb890677858f1f258f
I20260811 05:07:55.530438 13369 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:55.538014 13356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:55.528379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:53863 (local address 127.0.0.1:37893)
0811 05:07:55.528498 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:55.528502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:55.529071 (+ 569us) server_negotiation.cc:407] Connection header received
0811 05:07:55.529118 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:55.529121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:55.529167 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:55.529249 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:55.530137 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:55.531000 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:55.532194 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:55.532572 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:55.532668 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:55.534390 (+ 1722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:55.534394 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:55.534397 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:07:55.534466 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:55.536157 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:55.536710 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:55.536713 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:55.536715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:55.536793 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:07:55.537135 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:07:55.537138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:07:55.537139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:07:55.537323 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:55.537497 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:55.537762 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 05:07:55.537859 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 05:07:55.544837 13369 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:55.545722 13369 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:55.558223 13369 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6373086bf6324d728c1b9c666bc87494: Generated new TSK 0
I20260811 05:07:55.558949 13369 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:07:55.564869 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 13281
W20260811 05:07:55.575129 13261 connection.cc:535] client connection to 127.0.0.1:37893 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37893): Connection reset by peer (error 104)
2026-08-11T05:07:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1570 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:55 dist-test-slave-w206 krb5kdc[13386](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:55 dist-test-slave-w206 krb5kdc[13386](info): set up 2 sockets
Aug 11 05:07:55 dist-test-slave-w206 krb5kdc[13386](info): commencing operation
krb5kdc: starting...
W20260811 05:07:56.714123 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:07:56 dist-test-slave-w206 krb5kdc[13386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:07:56.850787 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34737
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34737
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:56.963997 13400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:56.964332 13400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:56.964424 13400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:56.968539 13400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:56.968631 13400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:56.968669 13400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:56.968734 13400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:56.968775 13400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:56.974165 13400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34737
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:56.975319 13400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:56.976358 13400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:56.985209 13405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:56.985289 13408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:56.985266 13400 server_base.cc:1034] running on GCE node
W20260811 05:07:56.985226 13406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:56.986018 13400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:56.987164 13400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:56.988343 13400 hybrid_clock.cc:648] HybridClock initialized: now 1786424876988312 us; error 42 us; skew 500 ppm
Aug 11 05:07:56 dist-test-slave-w206 krb5kdc[13386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424876, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:56.991210 13400 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:07:56.992151 13400 webserver.cc:460] Webserver started at http://127.0.0.1:42037/ using document root <none> and password file <none>
I20260811 05:07:56.992704 13400 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:56.992763 13400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:56.992931 13400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:56.995047 13400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "d426c8fbf8d54fd98d2f5bccbb992e24"
format_stamp: "Formatted at 2026-08-11 05:07:56 on dist-test-slave-w206"
server_key: "dfa7ec3371899aef0bf2a6d11347c6c9"
server_key_iv: "c26a9cb8868153f68989b75a56019575"
server_key_version: "encryptionkey@0"
I20260811 05:07:56.995623 13400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "d426c8fbf8d54fd98d2f5bccbb992e24"
format_stamp: "Formatted at 2026-08-11 05:07:56 on dist-test-slave-w206"
server_key: "dfa7ec3371899aef0bf2a6d11347c6c9"
server_key_iv: "c26a9cb8868153f68989b75a56019575"
server_key_version: "encryptionkey@0"
I20260811 05:07:56.999735 13400 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:07:57.002261 13415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:57.003556 13400 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:07:57.003660 13400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "d426c8fbf8d54fd98d2f5bccbb992e24"
format_stamp: "Formatted at 2026-08-11 05:07:56 on dist-test-slave-w206"
server_key: "dfa7ec3371899aef0bf2a6d11347c6c9"
server_key_iv: "c26a9cb8868153f68989b75a56019575"
server_key_version: "encryptionkey@0"
I20260811 05:07:57.003748 13400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:57.024044 13400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:57.027488 13400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:57.027704 13400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:57.035420 13400 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34737
I20260811 05:07:57.035449 13476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34737 every 8 connection(s)
I20260811 05:07:57.036412 13400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:57.038065 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 13400
I20260811 05:07:57.038228 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:07:57.038568 22727 external_mini_cluster.cc:1428] Setting key f58dc6195ba3b0c521d88cfb396dece3
I20260811 05:07:57.039664 13478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:57.045462 13478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24: Bootstrap starting.
I20260811 05:07:57.047724 13481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:57.040071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:39051 (local address 127.0.0.1:34737)
0811 05:07:57.040548 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:57.040564 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:57.040600 (+ 36us) server_negotiation.cc:407] Connection header received
0811 05:07:57.041240 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:57.041256 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:57.041591 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:57.041930 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:57.042338 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.043424 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.044333 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.044810 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.044992 (+ 182us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:57.046015 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:57.046019 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:57.046032 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:57.046405 (+ 373us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:57.046461 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:57.046484 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:57.046640 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:57.046840 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 05:07:57.047022 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":152,"threads_started":1}
I20260811 05:07:57.047797 13478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:57.048545 13478 log.cc:824] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:57.050637 13478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24: No bootstrap required, opened a new log
I20260811 05:07:57.050633 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:07:57.054872 13478 raft_consensus.cc:348] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d426c8fbf8d54fd98d2f5bccbb992e24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34737 } }
I20260811 05:07:57.055197 13478 raft_consensus.cc:374] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:57.055294 13478 raft_consensus.cc:729] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d426c8fbf8d54fd98d2f5bccbb992e24, State: Initialized, Role: FOLLOWER
I20260811 05:07:57.055763 13478 consensus_queue.cc:260] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d426c8fbf8d54fd98d2f5bccbb992e24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34737 } }
I20260811 05:07:57.055933 13478 raft_consensus.cc:388] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:57.056016 13478 raft_consensus.cc:482] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:57.056139 13478 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:57.057120 13481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:57.052808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:49781 (local address 127.0.0.1:34737)
0811 05:07:57.052964 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:57.052969 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:57.053135 (+ 166us) server_negotiation.cc:407] Connection header received
0811 05:07:57.053244 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:57.053246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:57.053283 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:57.053348 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:57.053641 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.054135 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.055253 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:07:57.055607 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:07:57.055709 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:07:57.056642 (+ 933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:57.056646 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:57.056647 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:57.056659 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:57.056684 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:57.056694 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:57.056763 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:57.056918 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 05:07:57.056953 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 05:07:57.057471 13478 raft_consensus.cc:504] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d426c8fbf8d54fd98d2f5bccbb992e24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34737 } }
I20260811 05:07:57.057828 13478 leader_election.cc:302] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d426c8fbf8d54fd98d2f5bccbb992e24; no voters:
I20260811 05:07:57.058156 13478 leader_election.cc:288] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:57.058264 13490 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:57.058557 13490 raft_consensus.cc:686] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [term 1 LEADER]: Becoming Leader. State: Replica: d426c8fbf8d54fd98d2f5bccbb992e24, State: Running, Role: LEADER
I20260811 05:07:57.058917 13490 consensus_queue.cc:237] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d426c8fbf8d54fd98d2f5bccbb992e24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34737 } }
I20260811 05:07:57.059571 13478 sys_catalog.cc:564] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:57.060750 13492 sys_catalog.cc:455] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d426c8fbf8d54fd98d2f5bccbb992e24. Latest consensus state: current_term: 1 leader_uuid: "d426c8fbf8d54fd98d2f5bccbb992e24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d426c8fbf8d54fd98d2f5bccbb992e24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34737 } } }
I20260811 05:07:57.060781 13491 sys_catalog.cc:455] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d426c8fbf8d54fd98d2f5bccbb992e24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d426c8fbf8d54fd98d2f5bccbb992e24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34737 } } }
I20260811 05:07:57.060984 13491 sys_catalog.cc:458] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:57.060984 13492 sys_catalog.cc:458] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:57.061890 13500 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:57.065197 13500 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:57.070943 13500 catalog_manager.cc:1347] Generated new cluster ID: 454cd65279184ad788290aed9478d5fa
I20260811 05:07:57.071038 13500 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:57.077926 13500 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:57.078794 13500 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:57.092182 13500 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d426c8fbf8d54fd98d2f5bccbb992e24: Generated new TSK 0
I20260811 05:07:57.093014 13500 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:07:57.099334 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 13400
W20260811 05:07:57.107781 13384 connection.cc:535] client connection to 127.0.0.1:34737 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34737): Connection reset by peer (error 104)
2026-08-11T05:07:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1532 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:57 dist-test-slave-w206 krb5kdc[13511](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:57 dist-test-slave-w206 krb5kdc[13511](info): set up 2 sockets
Aug 11 05:07:57 dist-test-slave-w206 krb5kdc[13511](info): commencing operation
krb5kdc: starting...
W20260811 05:07:58.203802 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.081s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:07:58 dist-test-slave-w206 krb5kdc[13511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:07:58.342962 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41875
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41875
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:58.455565 13528 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:58.455924 13528 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:58.456028 13528 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:58.460254 13528 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:58.460366 13528 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:58.460410 13528 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:58.460474 13528 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:58.460520 13528 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:58.465874 13528 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41875
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13528
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:58.466956 13528 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:58.468068 13528 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:58.476831 13535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:58.476831 13539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:58.476859 13537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:58.477010 13528 server_base.cc:1034] running on GCE node
I20260811 05:07:58.477823 13528 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:58.478927 13528 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:58.480135 13528 hybrid_clock.cc:648] HybridClock initialized: now 1786424878480109 us; error 39 us; skew 500 ppm
Aug 11 05:07:58 dist-test-slave-w206 krb5kdc[13511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424878, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:58.488240 13528 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:07:58.489308 13528 webserver.cc:460] Webserver started at http://127.0.0.1:43109/ using document root <none> and password file <none>
I20260811 05:07:58.489952 13528 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:58.490049 13528 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:58.490265 13528 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:58.492470 13528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "18af7b00e8404c93a916e068f1b768d3"
format_stamp: "Formatted at 2026-08-11 05:07:58 on dist-test-slave-w206"
server_key: "37cdc5f905a5127e0ac8a444065604a9"
server_key_iv: "50151c730d44d9f0d554fe239c1f485e"
server_key_version: "encryptionkey@0"
I20260811 05:07:58.493073 13528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "18af7b00e8404c93a916e068f1b768d3"
format_stamp: "Formatted at 2026-08-11 05:07:58 on dist-test-slave-w206"
server_key: "37cdc5f905a5127e0ac8a444065604a9"
server_key_iv: "50151c730d44d9f0d554fe239c1f485e"
server_key_version: "encryptionkey@0"
I20260811 05:07:58.496958 13528 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260811 05:07:58.499500 13547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:58.500718 13528 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:07:58.500865 13528 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "18af7b00e8404c93a916e068f1b768d3"
format_stamp: "Formatted at 2026-08-11 05:07:58 on dist-test-slave-w206"
server_key: "37cdc5f905a5127e0ac8a444065604a9"
server_key_iv: "50151c730d44d9f0d554fe239c1f485e"
server_key_version: "encryptionkey@0"
I20260811 05:07:58.500979 13528 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:58.505738 13528 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:58.508729 13528 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:58.508930 13528 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:07:58.516278 13528 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41875
I20260811 05:07:58.516335 13604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41875 every 8 connection(s)
I20260811 05:07:58.517242 13528 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:07:58.520197 13605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:07:58.520372 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 13528
I20260811 05:07:58.520527 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:07:58.520865 22727 external_mini_cluster.cc:1428] Setting key 1de7efd32f8f385420e28e6e2c7c2e83
I20260811 05:07:58.526561 13609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:58.522311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:33575 (local address 127.0.0.1:41875)
0811 05:07:58.522769 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:58.522788 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:58.522832 (+ 44us) server_negotiation.cc:407] Connection header received
0811 05:07:58.523661 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:58.523685 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:58.524051 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:58.524424 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:58.525148 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:58.525154 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:58.525167 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:58.525179 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:58.525243 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:58.525270 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:58.525409 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:58.525477 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 05:07:58.525631 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":128,"threads_started":1}
I20260811 05:07:58.527693 13605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3: Bootstrap starting.
I20260811 05:07:58.529418 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:07:58.530182 13605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3: Neither blocks nor log segments found. Creating new log.
I20260811 05:07:58.531176 13605 log.cc:824] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3: Log is configured to *not* fsync() on all Append() calls
I20260811 05:07:58.533316 13605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3: No bootstrap required, opened a new log
I20260811 05:07:58.535295 13609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:07:58.531977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:42063 (local address 127.0.0.1:41875)
0811 05:07:58.532119 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 05:07:58.532124 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:07:58.533731 (+ 1607us) server_negotiation.cc:407] Connection header received
0811 05:07:58.533841 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:07:58.533844 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:07:58.533880 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:07:58.533969 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:07:58.534804 (+ 835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:07:58.534810 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:07:58.534816 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:07:58.534828 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:07:58.534856 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:07:58.534868 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:07:58.534960 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 05:07:58.535114 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 05:07:58.535158 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 05:07:58.537209 13605 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18af7b00e8404c93a916e068f1b768d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41875 } }
I20260811 05:07:58.537421 13605 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:07:58.537495 13605 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18af7b00e8404c93a916e068f1b768d3, State: Initialized, Role: FOLLOWER
I20260811 05:07:58.537905 13605 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18af7b00e8404c93a916e068f1b768d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41875 } }
I20260811 05:07:58.538044 13605 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:07:58.538110 13605 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:07:58.538231 13605 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:07:58.539242 13605 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18af7b00e8404c93a916e068f1b768d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41875 } }
I20260811 05:07:58.539577 13605 leader_election.cc:302] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18af7b00e8404c93a916e068f1b768d3; no voters:
I20260811 05:07:58.539896 13605 leader_election.cc:288] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:07:58.540042 13618 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:07:58.540313 13618 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [term 1 LEADER]: Becoming Leader. State: Replica: 18af7b00e8404c93a916e068f1b768d3, State: Running, Role: LEADER
I20260811 05:07:58.540716 13618 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18af7b00e8404c93a916e068f1b768d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41875 } }
I20260811 05:07:58.541246 13605 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:07:58.542692 13620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18af7b00e8404c93a916e068f1b768d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18af7b00e8404c93a916e068f1b768d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41875 } } }
I20260811 05:07:58.542744 13621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18af7b00e8404c93a916e068f1b768d3. Latest consensus state: current_term: 1 leader_uuid: "18af7b00e8404c93a916e068f1b768d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18af7b00e8404c93a916e068f1b768d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41875 } } }
I20260811 05:07:58.542884 13621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [sys.catalog]: This master's current role is: LEADER
I20260811 05:07:58.542820 13620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3 [sys.catalog]: This master's current role is: LEADER
W20260811 05:07:58.546151 13638 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:07:58.546257 13638 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:07:58.546340 13634 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:07:58.547202 13634 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:07:58.553323 13634 catalog_manager.cc:1347] Generated new cluster ID: f6ac42545171419182657b5c3dd36871
I20260811 05:07:58.553387 13634 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:07:58.561631 13634 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:07:58.561964 13634 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:07:58.569430 13634 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18af7b00e8404c93a916e068f1b768d3: Generated new TSK 0
I20260811 05:07:58.570466 13634 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:07:58.582340 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 13528
2026-08-11T05:07:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1483 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:07:58 dist-test-slave-w206 krb5kdc[13645](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:07:58 dist-test-slave-w206 krb5kdc[13645](info): set up 2 sockets
Aug 11 05:07:58 dist-test-slave-w206 krb5kdc[13645](info): commencing operation
krb5kdc: starting...
W20260811 05:07:59.669616 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:07:59 dist-test-slave-w206 krb5kdc[13645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:07:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:07:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:07:59.826920 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40245
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40245
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:07:59.938596 13659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:07:59.938934 13659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:07:59.939059 13659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:07:59.943102 13659 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:07:59.943207 13659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:07:59.943245 13659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:07:59.943279 13659 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:07:59.943310 13659 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:07:59.948669 13659 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40245
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:07:59.949837 13659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:07:59.950955 13659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:07:59.959486 13668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:07:59.959491 13666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:59.959682 13659 server_base.cc:1034] running on GCE node
W20260811 05:07:59.959492 13665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:07:59.960453 13659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:07:59.961561 13659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:07:59.962729 13659 hybrid_clock.cc:648] HybridClock initialized: now 1786424879962706 us; error 38 us; skew 500 ppm
Aug 11 05:07:59 dist-test-slave-w206 krb5kdc[13645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424879, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:07:59.965775 13659 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:07:59.966698 13659 webserver.cc:460] Webserver started at http://127.0.0.1:45003/ using document root <none> and password file <none>
I20260811 05:07:59.967317 13659 fs_manager.cc:359] Metadata directory not provided
I20260811 05:07:59.967381 13659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:07:59.967624 13659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:07:59.969664 13659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "263da7d2b639408fa3364fc0ad27078b"
format_stamp: "Formatted at 2026-08-11 05:07:59 on dist-test-slave-w206"
server_key: "cd72b3d9c8039ef69d6ffda332305a4d"
server_key_iv: "624a5b0f13eec28a7b8a7fc4e45b2ba4"
server_key_version: "encryptionkey@0"
I20260811 05:07:59.970234 13659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "263da7d2b639408fa3364fc0ad27078b"
format_stamp: "Formatted at 2026-08-11 05:07:59 on dist-test-slave-w206"
server_key: "cd72b3d9c8039ef69d6ffda332305a4d"
server_key_iv: "624a5b0f13eec28a7b8a7fc4e45b2ba4"
server_key_version: "encryptionkey@0"
I20260811 05:07:59.974028 13659 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 05:07:59.976490 13675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:07:59.977664 13659 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 05:07:59.977798 13659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "263da7d2b639408fa3364fc0ad27078b"
format_stamp: "Formatted at 2026-08-11 05:07:59 on dist-test-slave-w206"
server_key: "cd72b3d9c8039ef69d6ffda332305a4d"
server_key_iv: "624a5b0f13eec28a7b8a7fc4e45b2ba4"
server_key_version: "encryptionkey@0"
I20260811 05:07:59.977912 13659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:07:59.995172 13659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:07:59.998221 13659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:07:59.998435 13659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:00.005856 13659 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40245
I20260811 05:08:00.005883 13731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40245 every 8 connection(s)
I20260811 05:08:00.006879 13659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:00.009681 13732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:00.014446 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 13659
I20260811 05:08:00.014590 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:08:00.014966 22727 external_mini_cluster.cc:1428] Setting key e75899f3e229b4dcb745d789181a7067
I20260811 05:08:00.015723 13732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b: Bootstrap starting.
I20260811 05:08:00.018589 13732 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:00.019537 13732 log.cc:824] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:00.021871 13732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b: No bootstrap required, opened a new log
Aug 11 05:08:00 dist-test-slave-w206 krb5kdc[13645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 05:08:00.026150 13732 raft_consensus.cc:348] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263da7d2b639408fa3364fc0ad27078b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40245 } }
I20260811 05:08:00.026458 13732 raft_consensus.cc:374] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:00.026512 13732 raft_consensus.cc:729] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 263da7d2b639408fa3364fc0ad27078b, State: Initialized, Role: FOLLOWER
I20260811 05:08:00.027076 13732 consensus_queue.cc:260] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263da7d2b639408fa3364fc0ad27078b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40245 } }
I20260811 05:08:00.027259 13732 raft_consensus.cc:388] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:00.027329 13732 raft_consensus.cc:482] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:00.027444 13732 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:00.028723 13732 raft_consensus.cc:504] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263da7d2b639408fa3364fc0ad27078b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40245 } }
I20260811 05:08:00.029115 13732 leader_election.cc:302] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 263da7d2b639408fa3364fc0ad27078b; no voters:
I20260811 05:08:00.029479 13732 leader_election.cc:288] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:00.029618 13737 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:00.029865 13737 raft_consensus.cc:686] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [term 1 LEADER]: Becoming Leader. State: Replica: 263da7d2b639408fa3364fc0ad27078b, State: Running, Role: LEADER
I20260811 05:08:00.030205 13737 consensus_queue.cc:237] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263da7d2b639408fa3364fc0ad27078b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40245 } }
I20260811 05:08:00.030854 13732 sys_catalog.cc:564] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:00.031901 13738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "263da7d2b639408fa3364fc0ad27078b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263da7d2b639408fa3364fc0ad27078b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40245 } } }
I20260811 05:08:00.032017 13738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:00.032986 13735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.016630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:44989 (local address 127.0.0.1:40245)
0811 05:08:00.017135 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:00.017164 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:00.017208 (+ 44us) server_negotiation.cc:407] Connection header received
0811 05:08:00.018056 (+ 848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:00.018080 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:00.018571 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:00.018989 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:00.019888 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:00.021286 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:00.022385 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:00.023087 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:00.023255 (+ 168us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:00.026453 (+ 3198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:00.026459 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:00.026477 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:00.026511 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:00.028917 (+ 2406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:00.029488 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:00.029496 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:00.029505 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:00.029648 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:00.030122 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:00.030125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:00.030127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:00.030622 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:00.030875 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:00.031592 (+ 717us) server_negotiation.cc:299] Negotiation successful
0811 05:08:00.031869 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":159,"threads_started":1}
I20260811 05:08:00.032307 13739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 263da7d2b639408fa3364fc0ad27078b. Latest consensus state: current_term: 1 leader_uuid: "263da7d2b639408fa3364fc0ad27078b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263da7d2b639408fa3364fc0ad27078b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40245 } } }
I20260811 05:08:00.034250 13739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b [sys.catalog]: This master's current role is: LEADER
W20260811 05:08:00.036079 13753 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:08:00.036158 13753 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:08:00.036258 13746 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:00.036340 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:08:00.037087 13746 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:00.043605 13746 catalog_manager.cc:1347] Generated new cluster ID: 1ac37c6e0ee344beb4217becc2c85851
I20260811 05:08:00.043678 13746 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:00.048193 13735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:00.038669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:38423 (local address 127.0.0.1:40245)
0811 05:08:00.038800 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:00.038805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:00.039136 (+ 331us) server_negotiation.cc:407] Connection header received
0811 05:08:00.039256 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:00.039260 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:00.039310 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:00.039396 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:00.040232 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:00.041508 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:00.042324 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:00.042570 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:00.042689 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:00.044581 (+ 1892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:00.044585 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:00.044588 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:00.044617 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:00.046285 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:00.046809 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:00.046812 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:00.046814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:00.046893 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:00.047252 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:00.047255 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:00.047257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:00.047477 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:00.047580 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:00.047950 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 05:08:00.048042 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 05:08:00.057117 13746 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:00.058357 13746 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:00.065001 13746 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 263da7d2b639408fa3364fc0ad27078b: Generated new TSK 0
I20260811 05:08:00.065834 13746 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:08:00.070349 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 13659
W20260811 05:08:00.079219 13643 connection.cc:535] client connection to 127.0.0.1:40245 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40245): Connection reset by peer (error 104)
2026-08-11T05:08:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1488 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:00 dist-test-slave-w206 krb5kdc[13766](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:00 dist-test-slave-w206 krb5kdc[13766](info): set up 2 sockets
Aug 11 05:08:00 dist-test-slave-w206 krb5kdc[13766](info): commencing operation
krb5kdc: starting...
W20260811 05:08:01.165634 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:08:01 dist-test-slave-w206 krb5kdc[13766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:08:01.297947 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40553
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:01.413609 13781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:01.413888 13781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:01.413932 13781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:01.417932 13781 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:01.417996 13781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:01.418016 13781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:01.418032 13781 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:01.418048 13781 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:01.423274 13781 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40553
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:08:01.424275 13781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:01.425231 13781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:01.433858 13789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:01.433972 13781 server_base.cc:1034] running on GCE node
W20260811 05:08:01.433856 13786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:01.434150 13787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:01.434800 13781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:01.435961 13781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:01.437160 13781 hybrid_clock.cc:648] HybridClock initialized: now 1786424881437133 us; error 40 us; skew 500 ppm
Aug 11 05:08:01 dist-test-slave-w206 krb5kdc[13766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424881, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:01.440130 13781 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:08:01.440994 13781 webserver.cc:460] Webserver started at http://127.0.0.1:37365/ using document root <none> and password file <none>
I20260811 05:08:01.441534 13781 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:01.441593 13781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:01.441756 13781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:01.443813 13781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "f48263a5464b4ddc83f3c6f1f36acfba"
format_stamp: "Formatted at 2026-08-11 05:08:01 on dist-test-slave-w206"
server_key: "75bf121878aec5a51fd164f52b0169b4"
server_key_iv: "c842a18322caf419524956c3328b8a7c"
server_key_version: "encryptionkey@0"
I20260811 05:08:01.444356 13781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "f48263a5464b4ddc83f3c6f1f36acfba"
format_stamp: "Formatted at 2026-08-11 05:08:01 on dist-test-slave-w206"
server_key: "75bf121878aec5a51fd164f52b0169b4"
server_key_iv: "c842a18322caf419524956c3328b8a7c"
server_key_version: "encryptionkey@0"
I20260811 05:08:01.448143 13781 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:08:01.450572 13797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:01.451877 13781 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260811 05:08:01.452019 13781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "f48263a5464b4ddc83f3c6f1f36acfba"
format_stamp: "Formatted at 2026-08-11 05:08:01 on dist-test-slave-w206"
server_key: "75bf121878aec5a51fd164f52b0169b4"
server_key_iv: "c842a18322caf419524956c3328b8a7c"
server_key_version: "encryptionkey@0"
I20260811 05:08:01.452135 13781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:01.481159 13781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:01.484678 13781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:01.484916 13781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:01.492427 13781 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40553
I20260811 05:08:01.492452 13857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40553 every 8 connection(s)
I20260811 05:08:01.493438 13781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:01.495357 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 13781
I20260811 05:08:01.495500 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:08:01.495837 22727 external_mini_cluster.cc:1428] Setting key 5f9538325284ef8f35fb4edf012b439e
I20260811 05:08:01.496621 13858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:01.502573 13858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba: Bootstrap starting.
I20260811 05:08:01.505115 13861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:01.497291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:60245 (local address 127.0.0.1:40553)
0811 05:08:01.497742 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:01.497757 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:01.497792 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:08:01.498445 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:01.498461 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:01.498791 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:01.499165 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:01.499576 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.500568 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.501477 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.501952 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.502136 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:01.503137 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:01.503143 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:01.503159 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:01.503639 (+ 480us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:01.503711 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:01.503749 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:01.503923 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:01.504060 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 05:08:01.504191 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":150,"threads_started":1}
I20260811 05:08:01.505400 13858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:01.506238 13858 log.cc:824] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:01.508275 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:08:01.508522 13858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba: No bootstrap required, opened a new log
I20260811 05:08:01.512806 13858 raft_consensus.cc:348] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48263a5464b4ddc83f3c6f1f36acfba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40553 } }
I20260811 05:08:01.513094 13858 raft_consensus.cc:374] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:01.513155 13858 raft_consensus.cc:729] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f48263a5464b4ddc83f3c6f1f36acfba, State: Initialized, Role: FOLLOWER
I20260811 05:08:01.513636 13858 consensus_queue.cc:260] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48263a5464b4ddc83f3c6f1f36acfba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40553 } }
I20260811 05:08:01.513825 13858 raft_consensus.cc:388] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:01.513899 13858 raft_consensus.cc:482] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:01.514015 13858 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:01.514732 13861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:01.510480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:49193 (local address 127.0.0.1:40553)
0811 05:08:01.510647 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:01.510653 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:01.510753 (+ 100us) server_negotiation.cc:407] Connection header received
0811 05:08:01.510864 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:01.510867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:01.510914 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:01.511029 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:01.511354 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.512153 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.512976 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:01.513310 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:01.513420 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:01.514307 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:01.514310 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:01.514313 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:01.514325 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:01.514354 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:01.514372 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:01.514460 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:01.514567 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 05:08:01.514603 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 05:08:01.515386 13858 raft_consensus.cc:504] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48263a5464b4ddc83f3c6f1f36acfba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40553 } }
I20260811 05:08:01.515748 13858 leader_election.cc:302] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f48263a5464b4ddc83f3c6f1f36acfba; no voters:
I20260811 05:08:01.516106 13858 leader_election.cc:288] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:01.516258 13868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:01.516474 13868 raft_consensus.cc:686] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [term 1 LEADER]: Becoming Leader. State: Replica: f48263a5464b4ddc83f3c6f1f36acfba, State: Running, Role: LEADER
I20260811 05:08:01.516822 13868 consensus_queue.cc:237] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48263a5464b4ddc83f3c6f1f36acfba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40553 } }
I20260811 05:08:01.517403 13858 sys_catalog.cc:564] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:01.518476 13870 sys_catalog.cc:455] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [sys.catalog]: SysCatalogTable state changed. Reason: New leader f48263a5464b4ddc83f3c6f1f36acfba. Latest consensus state: current_term: 1 leader_uuid: "f48263a5464b4ddc83f3c6f1f36acfba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48263a5464b4ddc83f3c6f1f36acfba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40553 } } }
I20260811 05:08:01.518603 13870 sys_catalog.cc:458] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:01.518918 13869 sys_catalog.cc:455] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f48263a5464b4ddc83f3c6f1f36acfba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48263a5464b4ddc83f3c6f1f36acfba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40553 } } }
I20260811 05:08:01.519024 13869 sys_catalog.cc:458] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:01.519047 13877 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:01.522373 13877 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:01.528041 13877 catalog_manager.cc:1347] Generated new cluster ID: 07682efdda92488e80c5f384aa4375b0
I20260811 05:08:01.528118 13877 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:01.537938 13877 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:01.539261 13877 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:01.549283 13877 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f48263a5464b4ddc83f3c6f1f36acfba: Generated new TSK 0
I20260811 05:08:01.550158 13877 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:08:01.559543 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 13781
W20260811 05:08:01.567286 13764 connection.cc:535] client connection to 127.0.0.1:40553 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40553): Connection reset by peer (error 104)
2026-08-11T05:08:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1487 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:01 dist-test-slave-w206 krb5kdc[13890](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:01 dist-test-slave-w206 krb5kdc[13890](info): set up 2 sockets
Aug 11 05:08:01 dist-test-slave-w206 krb5kdc[13890](info): commencing operation
krb5kdc: starting...
W20260811 05:08:02.661345 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:08:02 dist-test-slave-w206 krb5kdc[13890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 05:08:02.794829 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36655
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36655
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:02.909441 13906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:02.909705 13906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:02.909747 13906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:02.913879 13906 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:02.913944 13906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:02.913964 13906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:02.913981 13906 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:02.914039 13906 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:02.919355 13906 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36655
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:08:02.920464 13906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:02.921568 13906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:02.929929 13912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:02.929904 13913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:02.929912 13915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:02.930131 13906 server_base.cc:1034] running on GCE node
I20260811 05:08:02.930763 13906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:02.931910 13906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:02.933106 13906 hybrid_clock.cc:648] HybridClock initialized: now 1786424882933081 us; error 43 us; skew 500 ppm
Aug 11 05:08:02 dist-test-slave-w206 krb5kdc[13890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424882, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:02.935911 13906 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 05:08:02.936807 13906 webserver.cc:460] Webserver started at http://127.0.0.1:36379/ using document root <none> and password file <none>
I20260811 05:08:02.937314 13906 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:02.937371 13906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:02.937534 13906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:02.939585 13906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "b462561eaf8d479a9664f5e0fc182a84"
format_stamp: "Formatted at 2026-08-11 05:08:02 on dist-test-slave-w206"
server_key: "383d203df1f32628e93a1ea8c6c50248"
server_key_iv: "0cae178d887b506060e60d9e842dcff8"
server_key_version: "encryptionkey@0"
I20260811 05:08:02.940116 13906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "b462561eaf8d479a9664f5e0fc182a84"
format_stamp: "Formatted at 2026-08-11 05:08:02 on dist-test-slave-w206"
server_key: "383d203df1f32628e93a1ea8c6c50248"
server_key_iv: "0cae178d887b506060e60d9e842dcff8"
server_key_version: "encryptionkey@0"
I20260811 05:08:02.943773 13906 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 05:08:02.946156 13923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:02.947464 13906 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:08:02.947574 13906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "b462561eaf8d479a9664f5e0fc182a84"
format_stamp: "Formatted at 2026-08-11 05:08:02 on dist-test-slave-w206"
server_key: "383d203df1f32628e93a1ea8c6c50248"
server_key_iv: "0cae178d887b506060e60d9e842dcff8"
server_key_version: "encryptionkey@0"
I20260811 05:08:02.947746 13906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:02.952473 13906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:02.955359 13906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:02.955505 13906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:02.963783 13906 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36655
I20260811 05:08:02.963796 13981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36655 every 8 connection(s)
I20260811 05:08:02.964743 13906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:02.967598 13982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:02.972445 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 13906
I20260811 05:08:02.972616 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:08:02.972920 22727 external_mini_cluster.cc:1428] Setting key 12170a17dbd90c02c3103482ecef2862
I20260811 05:08:02.973460 13982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84: Bootstrap starting.
I20260811 05:08:02.976070 13982 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:02.976958 13982 log.cc:824] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:02.978269 13985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:02.974377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:55609 (local address 127.0.0.1:36655)
0811 05:08:02.974860 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:02.974875 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:02.974910 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:08:02.975612 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:02.975630 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:02.975919 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:02.976259 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:02.977091 (+ 832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:02.977098 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:02.977114 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:02.977127 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:02.977190 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:02.977211 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:02.977333 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:02.977438 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 05:08:02.977598 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":138,"threads_started":1}
I20260811 05:08:02.979066 13982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84: No bootstrap required, opened a new log
I20260811 05:08:02.981133 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:08:02.983379 13982 raft_consensus.cc:348] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b462561eaf8d479a9664f5e0fc182a84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36655 } }
I20260811 05:08:02.983680 13982 raft_consensus.cc:374] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:02.983752 13982 raft_consensus.cc:729] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b462561eaf8d479a9664f5e0fc182a84, State: Initialized, Role: FOLLOWER
I20260811 05:08:02.984155 13982 consensus_queue.cc:260] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b462561eaf8d479a9664f5e0fc182a84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36655 } }
I20260811 05:08:02.984305 13982 raft_consensus.cc:388] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:02.984371 13982 raft_consensus.cc:482] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:02.984472 13982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:02.985421 13982 raft_consensus.cc:504] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b462561eaf8d479a9664f5e0fc182a84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36655 } }
I20260811 05:08:02.985767 13982 leader_election.cc:302] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b462561eaf8d479a9664f5e0fc182a84; no voters:
I20260811 05:08:02.986080 13982 leader_election.cc:288] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:02.986202 13993 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:02.986460 13993 raft_consensus.cc:686] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [term 1 LEADER]: Becoming Leader. State: Replica: b462561eaf8d479a9664f5e0fc182a84, State: Running, Role: LEADER
I20260811 05:08:02.986786 13993 consensus_queue.cc:237] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b462561eaf8d479a9664f5e0fc182a84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36655 } }
I20260811 05:08:02.987545 13982 sys_catalog.cc:564] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:02.988684 13994 sys_catalog.cc:455] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b462561eaf8d479a9664f5e0fc182a84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b462561eaf8d479a9664f5e0fc182a84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36655 } } }
I20260811 05:08:02.988653 13995 sys_catalog.cc:455] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b462561eaf8d479a9664f5e0fc182a84. Latest consensus state: current_term: 1 leader_uuid: "b462561eaf8d479a9664f5e0fc182a84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b462561eaf8d479a9664f5e0fc182a84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36655 } } }
I20260811 05:08:02.988798 13994 sys_catalog.cc:458] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:02.988798 13995 sys_catalog.cc:458] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:02.989200 14003 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:02.989640 13985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:02.983499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:35767 (local address 127.0.0.1:36655)
0811 05:08:02.983613 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:02.983616 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:02.987275 (+ 3659us) server_negotiation.cc:407] Connection header received
0811 05:08:02.987581 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:02.987599 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:02.987640 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:02.987727 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:02.988721 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:02.988725 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:02.988727 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:02.988741 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:02.988774 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:02.988787 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:02.988868 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:02.989434 (+ 566us) server_negotiation.cc:299] Negotiation successful
0811 05:08:02.989489 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 05:08:02.992936 14003 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:02.998873 14003 catalog_manager.cc:1347] Generated new cluster ID: 7212c049856d4181bc4112817a496fdd
I20260811 05:08:02.998978 14003 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:03.008981 14003 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:03.009327 14003 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:03.017231 14003 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b462561eaf8d479a9664f5e0fc182a84: Generated new TSK 0
I20260811 05:08:03.018093 14003 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:08:03.023723 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 13906
2026-08-11T05:08:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1463 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:03 dist-test-slave-w206 krb5kdc[14016](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:03 dist-test-slave-w206 krb5kdc[14016](info): set up 2 sockets
Aug 11 05:08:03 dist-test-slave-w206 krb5kdc[14016](info): commencing operation
krb5kdc: starting...
W20260811 05:08:04.113853 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:08:04 dist-test-slave-w206 krb5kdc[14016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:08:04.254393 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:42765
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:44193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:42765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:04.366865 14029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:04.367164 14029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:04.367208 14029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:04.371233 14029 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:04.371291 14029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:04.371310 14029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:04.371327 14029 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:04.371343 14029 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:04.376551 14029 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:44193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:42765
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:42765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:08:04.377554 14029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:04.378504 14029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:08:04.387431 14029 server_base.cc:1034] running on GCE node
W20260811 05:08:04.387384 14042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:04.387468 14038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:04.387384 14039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:04.388204 14029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:04.389292 14029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:04.390501 14029 hybrid_clock.cc:648] HybridClock initialized: now 1786424884390452 us; error 32 us; skew 500 ppm
Aug 11 05:08:04 dist-test-slave-w206 krb5kdc[14016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424884, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:04.398855 14029 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:08:04.399863 14029 webserver.cc:460] Webserver started at http://127.22.49.254:39201/ using document root <none> and password file <none>
I20260811 05:08:04.400604 14029 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:04.400732 14029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:04.400975 14029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:04.403298 14029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "fc444ae4487c45b1b658e2f53b71e69b"
format_stamp: "Formatted at 2026-08-11 05:08:04 on dist-test-slave-w206"
server_key: "80ee5587d7f9bc792d833111bf5c0098"
server_key_iv: "54b6bef7f4bc8c390e88454a6a1365d3"
server_key_version: "encryptionkey@0"
I20260811 05:08:04.403903 14029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "fc444ae4487c45b1b658e2f53b71e69b"
format_stamp: "Formatted at 2026-08-11 05:08:04 on dist-test-slave-w206"
server_key: "80ee5587d7f9bc792d833111bf5c0098"
server_key_iv: "54b6bef7f4bc8c390e88454a6a1365d3"
server_key_version: "encryptionkey@0"
I20260811 05:08:04.407977 14029 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:08:04.410571 14049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:04.412027 14029 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:08:04.412189 14029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "fc444ae4487c45b1b658e2f53b71e69b"
format_stamp: "Formatted at 2026-08-11 05:08:04 on dist-test-slave-w206"
server_key: "80ee5587d7f9bc792d833111bf5c0098"
server_key_iv: "54b6bef7f4bc8c390e88454a6a1365d3"
server_key_version: "encryptionkey@0"
I20260811 05:08:04.412320 14029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:04.438388 14029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:04.441677 14029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:04.441921 14029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:04.449911 14029 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:42765
I20260811 05:08:04.449939 14108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:42765 every 8 connection(s)
I20260811 05:08:04.450917 14029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:04.452225 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 14029
I20260811 05:08:04.452397 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:08:04.452700 22727 external_mini_cluster.cc:1428] Setting key aac47fadfdd3965307a91b3b95762ab2
I20260811 05:08:04.454442 14109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:04.461838 14109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b: Bootstrap starting.
Aug 11 05:08:04 dist-test-slave-w206 krb5kdc[14016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:08:04.464793 14109 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:04.465637 14109 log.cc:824] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:04.468245 14109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b: No bootstrap required, opened a new log
I20260811 05:08:04.469698 14113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:04.454172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55979 (local address 127.22.49.254:42765)
0811 05:08:04.454630 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:04.454651 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:04.454698 (+ 47us) server_negotiation.cc:407] Connection header received
0811 05:08:04.455650 (+ 952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:04.455674 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:04.456137 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:04.456524 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:04.457260 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:04.459026 (+ 1766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:04.460044 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:04.460812 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:04.460998 (+ 186us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:04.464208 (+ 3210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:04.464213 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:04.464226 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:04.464262 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:04.466663 (+ 2401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:04.467326 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:04.467331 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:04.467336 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:04.467472 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:04.467829 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:04.467831 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:04.467832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:04.468200 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:04.468429 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:04.468717 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 05:08:04.468953 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":119,"threads_started":1}
I20260811 05:08:04.472069 14109 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc444ae4487c45b1b658e2f53b71e69b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42765 } }
I20260811 05:08:04.472312 14109 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:04.472406 14109 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc444ae4487c45b1b658e2f53b71e69b, State: Initialized, Role: FOLLOWER
I20260811 05:08:04.472699 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:08:04.472877 14109 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc444ae4487c45b1b658e2f53b71e69b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42765 } }
I20260811 05:08:04.473037 14109 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:04.473105 14109 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:04.473203 14109 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:04.474205 14109 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc444ae4487c45b1b658e2f53b71e69b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42765 } }
I20260811 05:08:04.474552 14109 leader_election.cc:302] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc444ae4487c45b1b658e2f53b71e69b; no voters:
I20260811 05:08:04.474893 14109 leader_election.cc:288] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:04.475023 14121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:04.475258 14121 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [term 1 LEADER]: Becoming Leader. State: Replica: fc444ae4487c45b1b658e2f53b71e69b, State: Running, Role: LEADER
I20260811 05:08:04.475600 14121 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc444ae4487c45b1b658e2f53b71e69b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42765 } }
I20260811 05:08:04.476146 14109 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:04.476835 14121 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc444ae4487c45b1b658e2f53b71e69b. Latest consensus state: current_term: 1 leader_uuid: "fc444ae4487c45b1b658e2f53b71e69b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc444ae4487c45b1b658e2f53b71e69b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42765 } } }
I20260811 05:08:04.476945 14121 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:04.477314 14130 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:04.478036 14124 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc444ae4487c45b1b658e2f53b71e69b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc444ae4487c45b1b658e2f53b71e69b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 42765 } } }
I20260811 05:08:04.478205 14124 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:04.480530 14130 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:04.485427 14113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:04.474933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34593 (local address 127.22.49.254:42765)
0811 05:08:04.475071 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:04.475076 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:04.475351 (+ 275us) server_negotiation.cc:407] Connection header received
0811 05:08:04.475533 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:04.475536 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:04.475580 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:04.475631 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:04.476533 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:04.477346 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:04.478403 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:04.478780 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:04.478901 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:04.481067 (+ 2166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:04.481071 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:04.481073 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:04.481096 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:04.482796 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:04.483422 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:04.483426 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:04.483428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:04.483519 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:04.483905 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:04.483909 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:04.483911 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:04.484132 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:04.484279 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:04.485238 (+ 959us) server_negotiation.cc:299] Negotiation successful
0811 05:08:04.485315 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 05:08:04.486603 14130 catalog_manager.cc:1347] Generated new cluster ID: 59b1f51e0d1b41b6ac43d10236f30f9e
I20260811 05:08:04.486667 14130 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:04.508337 14130 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:04.509397 14130 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:04.515125 14130 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc444ae4487c45b1b658e2f53b71e69b: Generated new TSK 0
I20260811 05:08:04.515861 14130 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:08:04.522761 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 14029
W20260811 05:08:04.532137 14014 connection.cc:535] client connection to 127.22.49.254:42765 recv error: Network error: failed to read from TLS socket (remote: 127.22.49.254:42765): Connection reset by peer (error 104)
2026-08-11T05:08:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1500 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:04 dist-test-slave-w206 krb5kdc[14144](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:04 dist-test-slave-w206 krb5kdc[14144](info): set up 2 sockets
Aug 11 05:08:04 dist-test-slave-w206 krb5kdc[14144](info): commencing operation
krb5kdc: starting...
W20260811 05:08:05.649505 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.008s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:08:05 dist-test-slave-w206 krb5kdc[14144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:08:05.783944 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:41939
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:41939
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:05.895884 14158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:05.896194 14158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:05.896270 14158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:05.900293 14158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:05.900389 14158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:05.900429 14158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:05.900488 14158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:05.900529 14158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:05.905758 14158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:41939
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:41939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:08:05.906833 14158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:05.907891 14158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:05.916631 14165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:05.916764 14167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:05.916672 14158 server_base.cc:1034] running on GCE node
W20260811 05:08:05.916699 14164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:05.917412 14158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:05.918547 14158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:05.919742 14158 hybrid_clock.cc:648] HybridClock initialized: now 1786424885919707 us; error 45 us; skew 500 ppm
Aug 11 05:08:05 dist-test-slave-w206 krb5kdc[14144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424885, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:05.922530 14158 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:08:05.923496 14158 webserver.cc:460] Webserver started at http://127.22.49.254:35375/ using document root <none> and password file <none>
I20260811 05:08:05.924052 14158 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:05.924144 14158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:05.924368 14158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:05.926435 14158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "a5caa8e510d64ee8a589604130bea4ca"
format_stamp: "Formatted at 2026-08-11 05:08:05 on dist-test-slave-w206"
server_key: "ef57d5e186713f584fac4528f9926451"
server_key_iv: "95fd80036f4965e0a59b93a04d4a8eb2"
server_key_version: "encryptionkey@0"
I20260811 05:08:05.927045 14158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "a5caa8e510d64ee8a589604130bea4ca"
format_stamp: "Formatted at 2026-08-11 05:08:05 on dist-test-slave-w206"
server_key: "ef57d5e186713f584fac4528f9926451"
server_key_iv: "95fd80036f4965e0a59b93a04d4a8eb2"
server_key_version: "encryptionkey@0"
I20260811 05:08:05.930727 14158 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 05:08:05.933137 14175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:05.934351 14158 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 05:08:05.934487 14158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "a5caa8e510d64ee8a589604130bea4ca"
format_stamp: "Formatted at 2026-08-11 05:08:05 on dist-test-slave-w206"
server_key: "ef57d5e186713f584fac4528f9926451"
server_key_iv: "95fd80036f4965e0a59b93a04d4a8eb2"
server_key_version: "encryptionkey@0"
I20260811 05:08:05.934592 14158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:05.973860 14158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:05.976924 14158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:05.977144 14158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:05.984588 14158 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:41939
I20260811 05:08:05.984617 14236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:41939 every 8 connection(s)
I20260811 05:08:05.985534 14158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:05.988258 14237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:05.991050 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 14158
I20260811 05:08:05.991212 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:08:05.991529 22727 external_mini_cluster.cc:1428] Setting key c57dffcbac5b157265866f02d3b84e7b
I20260811 05:08:05.994441 14237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca: Bootstrap starting.
I20260811 05:08:05.997107 14237 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:05.997968 14237 log.cc:824] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:06.000300 14237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca: No bootstrap required, opened a new log
I20260811 05:08:06.001035 14240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:05.992980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37925 (local address 127.22.49.254:41939)
0811 05:08:05.993418 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:05.993435 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:05.993470 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:08:05.994093 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:05.994112 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:05.994536 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:05.994931 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:05.995315 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:05.996289 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:05.997515 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:05.997979 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:05.998166 (+ 187us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:05.999189 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:05.999194 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:05.999206 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:05.999591 (+ 385us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:05.999645 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:05.999668 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:05.999771 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:05.999989 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 05:08:06.000251 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":145,"threads_started":1}
I20260811 05:08:06.004160 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:08:06.004596 14237 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5caa8e510d64ee8a589604130bea4ca" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 41939 } }
I20260811 05:08:06.004812 14237 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:06.004890 14237 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5caa8e510d64ee8a589604130bea4ca, State: Initialized, Role: FOLLOWER
I20260811 05:08:06.005334 14237 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5caa8e510d64ee8a589604130bea4ca" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 41939 } }
I20260811 05:08:06.005519 14237 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:06.005596 14237 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:06.005697 14237 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:06.006832 14237 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5caa8e510d64ee8a589604130bea4ca" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 41939 } }
I20260811 05:08:06.007256 14237 leader_election.cc:302] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5caa8e510d64ee8a589604130bea4ca; no voters:
I20260811 05:08:06.007614 14237 leader_election.cc:288] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:06.007709 14248 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:06.007915 14248 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [term 1 LEADER]: Becoming Leader. State: Replica: a5caa8e510d64ee8a589604130bea4ca, State: Running, Role: LEADER
I20260811 05:08:06.008246 14248 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5caa8e510d64ee8a589604130bea4ca" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 41939 } }
I20260811 05:08:06.008867 14237 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:06.009470 14248 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5caa8e510d64ee8a589604130bea4ca. Latest consensus state: current_term: 1 leader_uuid: "a5caa8e510d64ee8a589604130bea4ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5caa8e510d64ee8a589604130bea4ca" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 41939 } } }
I20260811 05:08:06.009594 14248 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:06.009907 14249 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5caa8e510d64ee8a589604130bea4ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5caa8e510d64ee8a589604130bea4ca" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 41939 } } }
I20260811 05:08:06.010015 14249 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:06.011320 14240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:06.006378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33581 (local address 127.22.49.254:41939)
0811 05:08:06.006517 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:06.006522 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:06.006704 (+ 182us) server_negotiation.cc:407] Connection header received
0811 05:08:06.006830 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:06.006832 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:06.006875 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:06.006939 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:06.007267 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:06.008004 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:06.009127 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:06.009456 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:06.009556 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:06.010713 (+ 1157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:06.010717 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:06.010720 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:06.010733 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:06.010759 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:06.010799 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:06.010915 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:06.011137 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 05:08:06.011172 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 05:08:06.011356 14253 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:06.014288 14253 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:06.019804 14253 catalog_manager.cc:1347] Generated new cluster ID: 97ddb719471041869a32c1947cddb571
I20260811 05:08:06.019884 14253 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:06.049266 14253 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:06.050323 14253 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:06.055335 14253 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5caa8e510d64ee8a589604130bea4ca: Generated new TSK 0
I20260811 05:08:06.056039 14253 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:08:06.065658 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 14158
W20260811 05:08:06.074236 14141 connection.cc:535] client connection to 127.22.49.254:41939 recv error: Network error: failed to read from TLS socket (remote: 127.22.49.254:41939): Connection reset by peer (error 104)
2026-08-11T05:08:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1541 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:06 dist-test-slave-w206 krb5kdc[14271](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:06 dist-test-slave-w206 krb5kdc[14271](info): set up 2 sockets
Aug 11 05:08:06 dist-test-slave-w206 krb5kdc[14271](info): commencing operation
krb5kdc: starting...
W20260811 05:08:07.179787 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:08:07 dist-test-slave-w206 krb5kdc[14271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:08:07.312067 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:43771
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:43771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:07.425904 14286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:07.426199 14286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:07.426272 14286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:07.430270 14286 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:07.430365 14286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:07.430405 14286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:07.430444 14286 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:07.430481 14286 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:07.435778 14286 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:43771
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:43771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:08:07.436838 14286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:07.437871 14286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:07.446486 14292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:07.446606 14286 server_base.cc:1034] running on GCE node
W20260811 05:08:07.446486 14291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:07.446575 14294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:07.447410 14286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:07.448483 14286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:07.449652 14286 hybrid_clock.cc:648] HybridClock initialized: now 1786424887449634 us; error 33 us; skew 500 ppm
Aug 11 05:08:07 dist-test-slave-w206 krb5kdc[14271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424887, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:07.452601 14286 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:08:07.453449 14286 webserver.cc:460] Webserver started at http://127.22.49.254:39049/ using document root <none> and password file <none>
I20260811 05:08:07.453958 14286 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:07.454016 14286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:07.454181 14286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:07.456236 14286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "a0d20a3ddbd64d1ba7514fa615846be9"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-w206"
server_key: "64709a098a4af0da8d0b6833e361fab3"
server_key_iv: "21d8d2389ce25e2268804067347de092"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.456758 14286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "a0d20a3ddbd64d1ba7514fa615846be9"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-w206"
server_key: "64709a098a4af0da8d0b6833e361fab3"
server_key_iv: "21d8d2389ce25e2268804067347de092"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.460393 14286 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 05:08:07.462731 14302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:07.464004 14286 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 05:08:07.464103 14286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "a0d20a3ddbd64d1ba7514fa615846be9"
format_stamp: "Formatted at 2026-08-11 05:08:07 on dist-test-slave-w206"
server_key: "64709a098a4af0da8d0b6833e361fab3"
server_key_iv: "21d8d2389ce25e2268804067347de092"
server_key_version: "encryptionkey@0"
I20260811 05:08:07.464187 14286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:07.468637 14286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:07.471827 14286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:07.471973 14286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:07.478561 14286 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:43771
I20260811 05:08:07.478641 14359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:43771 every 8 connection(s)
I20260811 05:08:07.479583 14286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:07.479841 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 14286
I20260811 05:08:07.480002 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:08:07.480355 22727 external_mini_cluster.cc:1428] Setting key 4e5ab023a060daf0a7214219c94bd099
I20260811 05:08:07.482662 14360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:07.485535 14363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.481765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59141 (local address 127.22.49.254:43771)
0811 05:08:07.482166 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.482184 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.482230 (+ 46us) server_negotiation.cc:407] Connection header received
0811 05:08:07.482918 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.482935 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.483280 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.483553 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.484356 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.484360 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.484371 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:07.484381 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.484433 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:07.484453 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.484558 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.484680 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.484846 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":145,"threads_started":1}
I20260811 05:08:07.488317 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:08:07.488906 14360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9: Bootstrap starting.
I20260811 05:08:07.491295 14360 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:07.492116 14360 log.cc:824] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:07.492306 14363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:07.490470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57691 (local address 127.22.49.254:43771)
0811 05:08:07.490605 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:07.490612 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:07.490846 (+ 234us) server_negotiation.cc:407] Connection header received
0811 05:08:07.491023 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:07.491026 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:07.491059 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:07.491152 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:07.491892 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:07.491896 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:07.491898 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:07.491910 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:07.491947 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:07.491959 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:07.492050 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:07.492134 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 05:08:07.492172 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:08:07.494134 14360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9: No bootstrap required, opened a new log
I20260811 05:08:07.497615 14360 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d20a3ddbd64d1ba7514fa615846be9" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43771 } }
I20260811 05:08:07.497828 14360 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:07.497861 14360 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0d20a3ddbd64d1ba7514fa615846be9, State: Initialized, Role: FOLLOWER
I20260811 05:08:07.498356 14360 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d20a3ddbd64d1ba7514fa615846be9" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43771 } }
I20260811 05:08:07.498493 14360 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:07.498541 14360 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:07.498615 14360 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:07.499562 14360 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d20a3ddbd64d1ba7514fa615846be9" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43771 } }
I20260811 05:08:07.499850 14360 leader_election.cc:302] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0d20a3ddbd64d1ba7514fa615846be9; no voters:
I20260811 05:08:07.500133 14360 leader_election.cc:288] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:07.500252 14371 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:07.500528 14371 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [term 1 LEADER]: Becoming Leader. State: Replica: a0d20a3ddbd64d1ba7514fa615846be9, State: Running, Role: LEADER
I20260811 05:08:07.500854 14371 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d20a3ddbd64d1ba7514fa615846be9" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43771 } }
I20260811 05:08:07.501466 14360 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:07.502526 14373 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0d20a3ddbd64d1ba7514fa615846be9. Latest consensus state: current_term: 1 leader_uuid: "a0d20a3ddbd64d1ba7514fa615846be9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d20a3ddbd64d1ba7514fa615846be9" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43771 } } }
I20260811 05:08:07.502539 14372 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0d20a3ddbd64d1ba7514fa615846be9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d20a3ddbd64d1ba7514fa615846be9" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 43771 } } }
I20260811 05:08:07.502662 14373 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:07.502666 14372 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:07.503103 14381 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:07.506249 14381 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:07.511900 14381 catalog_manager.cc:1347] Generated new cluster ID: 4c825100351a4c3485b929c9c4b984e6
I20260811 05:08:07.511992 14381 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:07.527586 14381 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:07.527956 14381 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:07.538625 14381 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0d20a3ddbd64d1ba7514fa615846be9: Generated new TSK 0
I20260811 05:08:07.539461 14381 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:08:07.544731 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 14286
2026-08-11T05:08:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1478 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:07 dist-test-slave-w206 krb5kdc[14394](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:07 dist-test-slave-w206 krb5kdc[14394](info): set up 2 sockets
Aug 11 05:08:07 dist-test-slave-w206 krb5kdc[14394](info): commencing operation
krb5kdc: starting...
W20260811 05:08:08.625357 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:08:08 dist-test-slave-w206 krb5kdc[14394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:08:08.758143 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:37125
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:45703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:37125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:08.869407 14407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:08.869693 14407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:08.869737 14407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:08.873790 14407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:08.873864 14407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:08.873884 14407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:08.873901 14407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:08.873960 14407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:08.879408 14407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:45703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:37125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:37125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:08:08.880535 14407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:08.881575 14407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:08.890190 14413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:08.890220 14415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:08.890198 14412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:08.890621 14407 server_base.cc:1034] running on GCE node
I20260811 05:08:08.891238 14407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:08.892330 14407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:08.893489 14407 hybrid_clock.cc:648] HybridClock initialized: now 1786424888893472 us; error 33 us; skew 500 ppm
Aug 11 05:08:08 dist-test-slave-w206 krb5kdc[14394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424888, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:08.896291 14407 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:08:08.897185 14407 webserver.cc:460] Webserver started at http://127.22.49.254:42079/ using document root <none> and password file <none>
I20260811 05:08:08.897687 14407 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:08.897746 14407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:08.897919 14407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:08.899945 14407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "d48895e2f9d944a6a67a76bdff29f919"
format_stamp: "Formatted at 2026-08-11 05:08:08 on dist-test-slave-w206"
server_key: "c7d3b9bf7b1f74b58d0d3d00812c4930"
server_key_iv: "527e803c94223b408f32ed60cbf9a92d"
server_key_version: "encryptionkey@0"
I20260811 05:08:08.900471 14407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "d48895e2f9d944a6a67a76bdff29f919"
format_stamp: "Formatted at 2026-08-11 05:08:08 on dist-test-slave-w206"
server_key: "c7d3b9bf7b1f74b58d0d3d00812c4930"
server_key_iv: "527e803c94223b408f32ed60cbf9a92d"
server_key_version: "encryptionkey@0"
I20260811 05:08:08.904232 14407 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:08:08.906514 14422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:08.907974 14407 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:08:08.908100 14407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "d48895e2f9d944a6a67a76bdff29f919"
format_stamp: "Formatted at 2026-08-11 05:08:08 on dist-test-slave-w206"
server_key: "c7d3b9bf7b1f74b58d0d3d00812c4930"
server_key_iv: "527e803c94223b408f32ed60cbf9a92d"
server_key_version: "encryptionkey@0"
I20260811 05:08:08.908237 14407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:08.936583 14407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:08.939862 14407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:08.940104 14407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:08.947643 14407 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:37125
I20260811 05:08:08.947660 14484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:37125 every 8 connection(s)
I20260811 05:08:08.948621 14407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:08.951557 14485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:08.956116 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 14407
I20260811 05:08:08.956286 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:08:08.956593 22727 external_mini_cluster.cc:1428] Setting key edf9939551355e9fa727172aab06631a
I20260811 05:08:08.958379 14485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919: Bootstrap starting.
I20260811 05:08:08.960865 14485 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:08.961637 14485 log.cc:824] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:08.963747 14485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919: No bootstrap required, opened a new log
Aug 11 05:08:08 dist-test-slave-w206 krb5kdc[14394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:08:08.967763 14485 raft_consensus.cc:348] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48895e2f9d944a6a67a76bdff29f919" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37125 } }
I20260811 05:08:08.968050 14485 raft_consensus.cc:374] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:08.968169 14485 raft_consensus.cc:729] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d48895e2f9d944a6a67a76bdff29f919, State: Initialized, Role: FOLLOWER
I20260811 05:08:08.968688 14485 consensus_queue.cc:260] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48895e2f9d944a6a67a76bdff29f919" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37125 } }
I20260811 05:08:08.968859 14485 raft_consensus.cc:388] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:08.968967 14485 raft_consensus.cc:482] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:08.969069 14485 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:08.970002 14485 raft_consensus.cc:504] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48895e2f9d944a6a67a76bdff29f919" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37125 } }
I20260811 05:08:08.970352 14485 leader_election.cc:302] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d48895e2f9d944a6a67a76bdff29f919; no voters:
I20260811 05:08:08.971131 14485 leader_election.cc:288] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:08.971230 14490 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:08.971459 14490 raft_consensus.cc:686] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [term 1 LEADER]: Becoming Leader. State: Replica: d48895e2f9d944a6a67a76bdff29f919, State: Running, Role: LEADER
I20260811 05:08:08.971470 14488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.958066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37065 (local address 127.22.49.254:37125)
0811 05:08:08.958572 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.958588 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.958626 (+ 38us) server_negotiation.cc:407] Connection header received
0811 05:08:08.959334 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.959353 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.959701 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.960049 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.960891 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.961990 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.962860 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.963387 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.963565 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.966130 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.966136 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.966148 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.966174 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.967994 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.968523 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.968529 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.968534 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.968682 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.969010 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.969013 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.969014 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.969493 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.969703 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.970019 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.970345 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":156,"threads_started":1}
I20260811 05:08:08.971835 14490 consensus_queue.cc:237] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48895e2f9d944a6a67a76bdff29f919" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37125 } }
I20260811 05:08:08.972514 14485 sys_catalog.cc:564] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:08.973631 14492 sys_catalog.cc:455] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d48895e2f9d944a6a67a76bdff29f919. Latest consensus state: current_term: 1 leader_uuid: "d48895e2f9d944a6a67a76bdff29f919" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48895e2f9d944a6a67a76bdff29f919" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37125 } } }
I20260811 05:08:08.973762 14492 sys_catalog.cc:458] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:08.974084 14491 sys_catalog.cc:455] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d48895e2f9d944a6a67a76bdff29f919" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48895e2f9d944a6a67a76bdff29f919" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37125 } } }
I20260811 05:08:08.974179 14491 sys_catalog.cc:458] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:08.974711 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:08:08.975201 14501 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:08.978319 14501 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:08.984741 14501 catalog_manager.cc:1347] Generated new cluster ID: bec6a422fa804b59ba78e53540421847
I20260811 05:08:08.985173 14501 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:08.985616 14488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:08.977284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53203 (local address 127.22.49.254:37125)
0811 05:08:08.977386 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:08.977390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:08.977404 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:08:08.977450 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:08.977453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:08.977497 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:08.977583 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:08.978429 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.979232 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.980352 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:08.980617 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:08.980736 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:08.982123 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:08.982129 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:08.982134 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:08.982160 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:08.983837 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.984279 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.984283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.984285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.984372 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:08.984718 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:08.984721 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:08.984723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:08.984943 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:08.985082 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:08.985343 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 05:08:08.985470 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 05:08:08.999608 14501 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:09.000974 14501 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:09.009199 14501 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d48895e2f9d944a6a67a76bdff29f919: Generated new TSK 0
I20260811 05:08:09.010064 14501 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:08:09.020474 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 14407
2026-08-11T05:08:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1474 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:09 dist-test-slave-w206 krb5kdc[14519](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:09 dist-test-slave-w206 krb5kdc[14519](info): set up 2 sockets
Aug 11 05:08:09 dist-test-slave-w206 krb5kdc[14519](info): commencing operation
krb5kdc: starting...
W20260811 05:08:10.150843 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:08:10 dist-test-slave-w206 krb5kdc[14519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:08:10.290050 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:38525
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:40593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:38525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:10.409737 14536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:10.410063 14536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:10.410146 14536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:10.414209 14536 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:10.414322 14536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:10.414363 14536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:10.414408 14536 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:10.414448 14536 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:10.419991 14536 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:40593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:38525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:38525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:08:10.421149 14536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:10.422518 14536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:10.431646 14544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:10.431722 14541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:10.431670 14542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:10.431831 14536 server_base.cc:1034] running on GCE node
I20260811 05:08:10.432446 14536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:10.433589 14536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:10.434757 14536 hybrid_clock.cc:648] HybridClock initialized: now 1786424890434735 us; error 34 us; skew 500 ppm
Aug 11 05:08:10 dist-test-slave-w206 krb5kdc[14519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424890, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:10.437815 14536 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:08:10.438776 14536 webserver.cc:460] Webserver started at http://127.22.49.254:36645/ using document root <none> and password file <none>
I20260811 05:08:10.439394 14536 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:10.439462 14536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:10.439690 14536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:10.441749 14536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "1c338d6ece85422bab11a8f4fb26da7f"
format_stamp: "Formatted at 2026-08-11 05:08:10 on dist-test-slave-w206"
server_key: "b9f5f48048c86e30ac62996ed6d2d6ff"
server_key_iv: "0e93dbc346ea855faf53a375270e7865"
server_key_version: "encryptionkey@0"
I20260811 05:08:10.442333 14536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "1c338d6ece85422bab11a8f4fb26da7f"
format_stamp: "Formatted at 2026-08-11 05:08:10 on dist-test-slave-w206"
server_key: "b9f5f48048c86e30ac62996ed6d2d6ff"
server_key_iv: "0e93dbc346ea855faf53a375270e7865"
server_key_version: "encryptionkey@0"
I20260811 05:08:10.446132 14536 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 05:08:10.448647 14553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:10.449883 14536 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 05:08:10.450028 14536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "1c338d6ece85422bab11a8f4fb26da7f"
format_stamp: "Formatted at 2026-08-11 05:08:10 on dist-test-slave-w206"
server_key: "b9f5f48048c86e30ac62996ed6d2d6ff"
server_key_iv: "0e93dbc346ea855faf53a375270e7865"
server_key_version: "encryptionkey@0"
I20260811 05:08:10.450142 14536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:10.464100 14536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:10.467517 14536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:10.467727 14536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:10.474766 14536 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:38525
I20260811 05:08:10.474792 14606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:38525 every 8 connection(s)
I20260811 05:08:10.475764 14536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:10.478277 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 14536
I20260811 05:08:10.478430 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:08:10.478691 14607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:10.478794 22727 external_mini_cluster.cc:1428] Setting key 93dfdeaa62e2441a8648b344fcf8fcd5
I20260811 05:08:10.485080 14607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f: Bootstrap starting.
I20260811 05:08:10.487546 14607 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:10.487694 14611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.480250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56243 (local address 127.22.49.254:38525)
0811 05:08:10.480679 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:10.480693 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:10.480726 (+ 33us) server_negotiation.cc:407] Connection header received
0811 05:08:10.481418 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:10.481434 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:10.481751 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:10.482073 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:10.482467 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.483523 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.484438 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.484901 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.485087 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.485957 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:10.485962 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:10.485974 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:10.486348 (+ 374us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:10.486402 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:10.486435 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:10.486550 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:10.486690 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 05:08:10.486892 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":136,"threads_started":1}
I20260811 05:08:10.488469 14607 log.cc:824] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:10.490615 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:08:10.490674 14607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f: No bootstrap required, opened a new log
I20260811 05:08:10.494959 14607 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c338d6ece85422bab11a8f4fb26da7f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 38525 } }
I20260811 05:08:10.495334 14607 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:10.495436 14607 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c338d6ece85422bab11a8f4fb26da7f, State: Initialized, Role: FOLLOWER
I20260811 05:08:10.495972 14607 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c338d6ece85422bab11a8f4fb26da7f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 38525 } }
I20260811 05:08:10.496179 14607 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:10.496264 14607 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:10.496378 14607 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:10.497107 14611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:10.492758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35365 (local address 127.22.49.254:38525)
0811 05:08:10.492903 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:10.492915 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:10.493156 (+ 241us) server_negotiation.cc:407] Connection header received
0811 05:08:10.493225 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:10.493227 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:10.493265 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:10.493337 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:10.493638 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.494131 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.495232 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:10.495604 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:10.495715 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:10.496663 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:10.496666 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:10.496668 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:10.496679 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:10.496703 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:10.496714 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:10.496768 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:10.496891 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 05:08:10.496947 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 05:08:10.497695 14607 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c338d6ece85422bab11a8f4fb26da7f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 38525 } }
I20260811 05:08:10.498100 14607 leader_election.cc:302] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c338d6ece85422bab11a8f4fb26da7f; no voters:
I20260811 05:08:10.498436 14607 leader_election.cc:288] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:10.498598 14618 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:10.498884 14618 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [term 1 LEADER]: Becoming Leader. State: Replica: 1c338d6ece85422bab11a8f4fb26da7f, State: Running, Role: LEADER
I20260811 05:08:10.499269 14618 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c338d6ece85422bab11a8f4fb26da7f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 38525 } }
I20260811 05:08:10.499861 14607 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:10.501118 14619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c338d6ece85422bab11a8f4fb26da7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c338d6ece85422bab11a8f4fb26da7f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 38525 } } }
I20260811 05:08:10.501127 14621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c338d6ece85422bab11a8f4fb26da7f. Latest consensus state: current_term: 1 leader_uuid: "1c338d6ece85422bab11a8f4fb26da7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c338d6ece85422bab11a8f4fb26da7f" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 38525 } } }
I20260811 05:08:10.501276 14619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:10.501276 14621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f [sys.catalog]: This master's current role is: LEADER
W20260811 05:08:10.504967 14637 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:08:10.505045 14637 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:08:10.505117 14631 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:10.505955 14631 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:10.511951 14631 catalog_manager.cc:1347] Generated new cluster ID: 0ac1fd2657e14e6488187c989781e104
I20260811 05:08:10.512041 14631 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:10.539209 14631 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:10.540230 14631 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:10.545352 14631 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c338d6ece85422bab11a8f4fb26da7f: Generated new TSK 0
I20260811 05:08:10.546213 14631 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:08:10.554106 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 14536
2026-08-11T05:08:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1534 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:10 dist-test-slave-w206 krb5kdc[14643](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:10 dist-test-slave-w206 krb5kdc[14643](info): set up 2 sockets
Aug 11 05:08:10 dist-test-slave-w206 krb5kdc[14643](info): commencing operation
krb5kdc: starting...
W20260811 05:08:11.706146 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:08:11 dist-test-slave-w206 krb5kdc[14643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:08:11.842532 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:40197
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:38767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:40197
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:11.957433 14657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:11.957764 14657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:11.957855 14657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:11.961951 14657 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:11.962060 14657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:11.962103 14657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:11.962164 14657 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:11.962205 14657 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:11.967640 14657 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:38767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:40197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:40197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:08:11.968830 14657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:11.969914 14657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:11.979154 14662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:11.979214 14657 server_base.cc:1034] running on GCE node
W20260811 05:08:11.979226 14663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:11.979396 14665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:11.980011 14657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:11.981112 14657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:11.982277 14657 hybrid_clock.cc:648] HybridClock initialized: now 1786424891982261 us; error 33 us; skew 500 ppm
Aug 11 05:08:11 dist-test-slave-w206 krb5kdc[14643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424891, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:11.985229 14657 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:08:11.986151 14657 webserver.cc:460] Webserver started at http://127.22.49.254:46517/ using document root <none> and password file <none>
I20260811 05:08:11.986692 14657 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:11.986752 14657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:11.986922 14657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:11.989007 14657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "5c4cb9bd98c748a2b1645afb18189f7b"
format_stamp: "Formatted at 2026-08-11 05:08:11 on dist-test-slave-w206"
server_key: "ccfc0db4772a136eafaf2d350f302731"
server_key_iv: "65d0d32a8461221d6e47107c07d41904"
server_key_version: "encryptionkey@0"
I20260811 05:08:11.989526 14657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "5c4cb9bd98c748a2b1645afb18189f7b"
format_stamp: "Formatted at 2026-08-11 05:08:11 on dist-test-slave-w206"
server_key: "ccfc0db4772a136eafaf2d350f302731"
server_key_iv: "65d0d32a8461221d6e47107c07d41904"
server_key_version: "encryptionkey@0"
I20260811 05:08:11.993448 14657 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 05:08:11.996134 14673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:11.997611 14657 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:08:11.997798 14657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "5c4cb9bd98c748a2b1645afb18189f7b"
format_stamp: "Formatted at 2026-08-11 05:08:11 on dist-test-slave-w206"
server_key: "ccfc0db4772a136eafaf2d350f302731"
server_key_iv: "65d0d32a8461221d6e47107c07d41904"
server_key_version: "encryptionkey@0"
I20260811 05:08:11.997939 14657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:12.003084 14657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:12.006839 14657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:12.007119 14657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:12.015491 14657 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:40197
I20260811 05:08:12.015524 14734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:40197 every 8 connection(s)
I20260811 05:08:12.016561 14657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:12.019474 14735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:12.020460 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 14657
I20260811 05:08:12.020619 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:08:12.020954 22727 external_mini_cluster.cc:1428] Setting key e6d6279e5d0039448585071f251a0d1b
I20260811 05:08:12.025935 14735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b: Bootstrap starting.
I20260811 05:08:12.026569 14738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.022540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50791 (local address 127.22.49.254:40197)
0811 05:08:12.023089 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.023105 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.023143 (+ 38us) server_negotiation.cc:407] Connection header received
0811 05:08:12.023842 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.023857 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.024139 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.024488 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:12.025331 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:12.025336 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:12.025347 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:12.025359 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:12.025415 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:12.025433 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:12.025594 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.025665 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.025825 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":147,"threads_started":1}
I20260811 05:08:12.028429 14735 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:12.029320 14735 log.cc:824] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:12.029686 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:08:12.031363 14735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b: No bootstrap required, opened a new log
I20260811 05:08:12.033547 14738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:12.031933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48969 (local address 127.22.49.254:40197)
0811 05:08:12.032060 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:12.032064 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:12.032227 (+ 163us) server_negotiation.cc:407] Connection header received
0811 05:08:12.032310 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:12.032313 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:12.032348 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:12.032437 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:12.033168 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:12.033172 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:12.033175 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 05:08:12.033187 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:12.033216 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 05:08:12.033229 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:12.033321 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:12.033388 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 05:08:12.033426 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 05:08:12.035813 14735 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c4cb9bd98c748a2b1645afb18189f7b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40197 } }
I20260811 05:08:12.036031 14735 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 05:08:12.036065 14735 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c4cb9bd98c748a2b1645afb18189f7b, State: Initialized, Role: FOLLOWER
I20260811 05:08:12.036422 14735 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c4cb9bd98c748a2b1645afb18189f7b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40197 } }
I20260811 05:08:12.036530 14735 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 05:08:12.036568 14735 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 05:08:12.036636 14735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:12.037494 14735 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c4cb9bd98c748a2b1645afb18189f7b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40197 } }
I20260811 05:08:12.037781 14735 leader_election.cc:302] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c4cb9bd98c748a2b1645afb18189f7b; no voters:
I20260811 05:08:12.038053 14735 leader_election.cc:288] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 05:08:12.038177 14745 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:12.038481 14745 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [term 1 LEADER]: Becoming Leader. State: Replica: 5c4cb9bd98c748a2b1645afb18189f7b, State: Running, Role: LEADER
I20260811 05:08:12.038776 14745 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c4cb9bd98c748a2b1645afb18189f7b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40197 } }
I20260811 05:08:12.039451 14735 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:12.040740 14747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c4cb9bd98c748a2b1645afb18189f7b. Latest consensus state: current_term: 1 leader_uuid: "5c4cb9bd98c748a2b1645afb18189f7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c4cb9bd98c748a2b1645afb18189f7b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40197 } } }
I20260811 05:08:12.040750 14746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c4cb9bd98c748a2b1645afb18189f7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c4cb9bd98c748a2b1645afb18189f7b" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 40197 } } }
I20260811 05:08:12.040951 14747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:12.040982 14746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:12.041867 14757 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:12.044744 14757 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:12.050299 14757 catalog_manager.cc:1347] Generated new cluster ID: 2de4388b0e5a47609cffaf5e1fb98c0f
I20260811 05:08:12.050375 14757 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:12.063767 14757 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:12.064110 14757 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:12.075834 14757 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c4cb9bd98c748a2b1645afb18189f7b: Generated new TSK 0
I20260811 05:08:12.076730 14757 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 05:08:12.089745 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 14657
2026-08-11T05:08:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1535 ms)
[----------] 18 tests from AuthTokenIssuingTest (27395 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:12 dist-test-slave-w206 krb5kdc[14769](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:12 dist-test-slave-w206 krb5kdc[14769](info): set up 2 sockets
Aug 11 05:08:12 dist-test-slave-w206 krb5kdc[14769](info): commencing operation
krb5kdc: starting...
W20260811 05:08:13.196842 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.084s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:08:13 dist-test-slave-w206 krb5kdc[14769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:08:13.338018 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:37293
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:37597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:37293,127.22.49.253:37905,127.22.49.252:36165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:13.454704 14785 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 05:08:13.455121 14785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:13.455197 14785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:13.455317 14785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:13.459403 14785 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:13.459488 14785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:13.459532 14785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:13.459595 14785 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:13.459638 14785 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:13.465001 14785 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:37597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:37293,127.22.49.253:37905,127.22.49.252:36165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:37293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:08:13.466116 14785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:13.467201 14785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 05:08:13.475893 14785 server_base.cc:1034] running on GCE node
W20260811 05:08:13.475831 14790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:13.475829 14791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:13.475831 14793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:13.476660 14785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:13.477800 14785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:13.479053 14785 hybrid_clock.cc:648] HybridClock initialized: now 1786424893479035 us; error 32 us; skew 500 ppm
Aug 11 05:08:13 dist-test-slave-w206 krb5kdc[14769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:13.481986 14785 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:08:13.482918 14785 webserver.cc:460] Webserver started at http://127.22.49.254:36037/ using document root <none> and password file <none>
I20260811 05:08:13.483518 14785 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:13.483587 14785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:13.483769 14785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:13.485865 14785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "c107d38beeda485b83c7225eacf08a56"
format_stamp: "Formatted at 2026-08-11 05:08:13 on dist-test-slave-w206"
server_key: "20dc4123b1c6604d2b11d55c0884c529"
server_key_iv: "1e85df58b1c9d98a20d326ddc1b7ced3"
server_key_version: "encryptionkey@0"
I20260811 05:08:13.486426 14785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "c107d38beeda485b83c7225eacf08a56"
format_stamp: "Formatted at 2026-08-11 05:08:13 on dist-test-slave-w206"
server_key: "20dc4123b1c6604d2b11d55c0884c529"
server_key_iv: "1e85df58b1c9d98a20d326ddc1b7ced3"
server_key_version: "encryptionkey@0"
I20260811 05:08:13.490378 14785 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 05:08:13.492933 14800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:13.494128 14785 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:08:13.494234 14785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "c107d38beeda485b83c7225eacf08a56"
format_stamp: "Formatted at 2026-08-11 05:08:13 on dist-test-slave-w206"
server_key: "20dc4123b1c6604d2b11d55c0884c529"
server_key_iv: "1e85df58b1c9d98a20d326ddc1b7ced3"
server_key_version: "encryptionkey@0"
I20260811 05:08:13.494324 14785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:13.507620 14785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:13.510485 14785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:13.510644 14785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:13.518174 14785 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:37293
I20260811 05:08:13.518505 14862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:37293 every 8 connection(s)
I20260811 05:08:13.519243 14785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:13.522113 14863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:13.525712 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 14785
I20260811 05:08:13.525863 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:08:13.526149 22727 external_mini_cluster.cc:1428] Setting key 0af66b099bec4a67013bff7622aeef03
I20260811 05:08:13.526137 14863 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.49.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.253@KRBTEST.COM" created.
Aug 11 05:08:13 dist-test-slave-w206 krb5kdc[14769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:08:13.545862 14867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.528790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48184 (local address 127.22.49.254:37293)
0811 05:08:13.529394 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.529408 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.529457 (+ 49us) server_negotiation.cc:407] Connection header received
0811 05:08:13.530959 (+ 1502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.530964 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.531208 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.531364 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:13.532590 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.533464 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.535067 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.535427 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.535554 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.540301 (+ 4747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:13.540307 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:13.540319 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:13.540341 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:13.542544 (+ 2203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:13.543222 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:13.543227 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:13.543228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:13.543343 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:13.543732 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:13.543734 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:13.543744 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:13.544161 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:13.544266 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:13.544784 (+ 518us) server_negotiation.cc:299] Negotiation successful
0811 05:08:13.545063 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":485,"spinlock_wait_cycles":84736,"thread_start_us":207,"threads_started":1}
I20260811 05:08:13.545866 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.528790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37293 (local address 127.0.0.1:48184)
0811 05:08:13.529304 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.529360 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:13.530633 (+ 1273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:13.531451 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:13.531460 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:13.532000 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:13.532410 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.532435 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.533623 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.533628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.534894 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.534907 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.535613 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.535618 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.535780 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.536430 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:13.536458 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:13.540126 (+ 3668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:13.542704 (+ 2578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:13.542718 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:13.542733 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:13.543108 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:13.543450 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:13.543456 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:13.543461 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:13.543627 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:13.544295 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:13.544306 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:13.544507 (+ 201us) client_negotiation.cc:769] Sending connection context
0811 05:08:13.544718 (+ 211us) client_negotiation.cc:240] Negotiation successful
0811 05:08:13.545181 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":97,"thread_start_us":146,"threads_started":1}
I20260811 05:08:13.548300 14863 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:08:13.549100 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.548840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:37905 (local address 127.0.0.1:57524)
0811 05:08:13.548969 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.549041 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:37905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 05:08:13.549413 14802 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.49.253:37905: connect: Connection refused (error 111)
I20260811 05:08:13.550295 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.550027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:37905 (local address 127.0.0.1:57538)
0811 05:08:13.550126 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.550198 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:37905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 05:08:13.550549 14863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.253:37905: Network error: Client connection negotiation failed: client connection to 127.22.49.253:37905: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.253.keytab.
Entry for principal kudu/127.22.49.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.253.keytab.
I20260811 05:08:13.558967 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.253:37905
--webserver_interface=127.22.49.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.253.keytab
--principal=kudu/127.22.49.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:37597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:37293,127.22.49.253:37905,127.22.49.252:36165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:08:13.599795 14863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } attempt: 1
I20260811 05:08:13.600754 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.600451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:37905 (local address 127.0.0.1:57540)
0811 05:08:13.600609 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.600674 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:37905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 05:08:13.601516 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.601303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:37905 (local address 127.0.0.1:57544)
0811 05:08:13.601418 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.601463 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:37905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 05:08:13.601650 14863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.253:37905: Network error: Client connection negotiation failed: client connection to 127.22.49.253:37905: connect: Connection refused (error 111)
I20260811 05:08:13.669828 14863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } attempt: 2
I20260811 05:08:13.670663 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.670345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:37905 (local address 127.0.0.1:57550)
0811 05:08:13.670514 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.670579 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:37905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 05:08:13.671416 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.671191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:37905 (local address 127.0.0.1:57554)
0811 05:08:13.671300 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.671347 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:37905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 05:08:13.671553 14863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.253:37905: Network error: Client connection negotiation failed: client connection to 127.22.49.253:37905: connect: Connection refused (error 111)
W20260811 05:08:13.672708 14870 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 05:08:13.672969 14870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:13.672994 14870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:13.673038 14870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:13.677129 14870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:13.677189 14870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:13.677209 14870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:13.677227 14870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:13.677242 14870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:13.683408 14870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:37597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:37293,127.22.49.253:37905,127.22.49.252:36165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.253.keytab
--principal=kudu/127.22.49.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.253:37905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.49.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:08:13.684587 14870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:13.685659 14870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:13.694965 14876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:13.695042 14875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:13.695042 14870 server_base.cc:1034] running on GCE node
W20260811 05:08:13.695065 14878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:13.695885 14870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:13.697103 14870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:13.698302 14870 hybrid_clock.cc:648] HybridClock initialized: now 1786424893698282 us; error 57 us; skew 500 ppm
Aug 11 05:08:13 dist-test-slave-w206 krb5kdc[14769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:13.701531 14870 init.cc:377] Logged in from keytab as kudu/127.22.49.253@KRBTEST.COM (short username kudu)
I20260811 05:08:13.702543 14870 webserver.cc:460] Webserver started at http://127.22.49.253:44807/ using document root <none> and password file <none>
I20260811 05:08:13.703227 14870 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:13.703330 14870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:13.703589 14870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:13.705842 14870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/data/instance:
uuid: "8811c45484184b41917d362aac60cc05"
format_stamp: "Formatted at 2026-08-11 05:08:13 on dist-test-slave-w206"
server_key: "6cf9314c2a1fb153c61697a2e00ffffb"
server_key_iv: "0f571322899e18e9bb2b798cb37cd12a"
server_key_version: "encryptionkey@0"
I20260811 05:08:13.706475 14870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/wal/instance:
uuid: "8811c45484184b41917d362aac60cc05"
format_stamp: "Formatted at 2026-08-11 05:08:13 on dist-test-slave-w206"
server_key: "6cf9314c2a1fb153c61697a2e00ffffb"
server_key_iv: "0f571322899e18e9bb2b798cb37cd12a"
server_key_version: "encryptionkey@0"
I20260811 05:08:13.710615 14870 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 05:08:13.713420 14885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:13.715198 14870 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:08:13.715358 14870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/wal
uuid: "8811c45484184b41917d362aac60cc05"
format_stamp: "Formatted at 2026-08-11 05:08:13 on dist-test-slave-w206"
server_key: "6cf9314c2a1fb153c61697a2e00ffffb"
server_key_iv: "0f571322899e18e9bb2b798cb37cd12a"
server_key_version: "encryptionkey@0"
I20260811 05:08:13.715485 14870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:13.730886 14870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:13.734509 14870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:13.734745 14870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:13.742570 14870 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.253:37905
I20260811 05:08:13.742887 14947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.253:37905 every 8 connection(s)
I20260811 05:08:13.743754 14870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/data/info.pb
I20260811 05:08:13.746554 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 14870
I20260811 05:08:13.746559 14948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:13.746696 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-1/wal/instance
I20260811 05:08:13.747046 22727 external_mini_cluster.cc:1428] Setting key 46d31b6600359b79ec3cbd88ca25d5d1
I20260811 05:08:13.750478 14948 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.49.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.252@KRBTEST.COM" created.
Aug 11 05:08:13 dist-test-slave-w206 krb5kdc[14769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.253@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:08:13.762710 14863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } attempt: 3
I20260811 05:08:13.766582 14867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.752498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48194 (local address 127.22.49.254:37293)
0811 05:08:13.752670 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.752675 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.753531 (+ 856us) server_negotiation.cc:407] Connection header received
0811 05:08:13.754452 (+ 921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.754457 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.754531 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.754647 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:13.755868 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.756855 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.757997 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.758253 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.758355 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.761127 (+ 2772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:13.761130 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:13.761133 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:13.761158 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:13.763457 (+ 2299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:13.764164 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:13.764171 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:13.764175 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:13.764272 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:13.764665 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:13.764668 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:13.764670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:13.764856 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:13.764968 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:13.766285 (+ 1317us) server_negotiation.cc:299] Negotiation successful
0811 05:08:13.766432 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 05:08:13.767143 14951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.752868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37293 (local address 127.0.0.1:48194)
0811 05:08:13.753347 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.753401 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:13.754236 (+ 835us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:13.754791 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:13.754798 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:13.755228 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:13.755689 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.755702 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.756992 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.756995 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.757861 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.757890 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.758392 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.758395 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.758535 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.759276 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:13.759293 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:13.760920 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:13.763591 (+ 2671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:13.763600 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:13.763630 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:13.764033 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:13.764370 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:13.764373 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:13.764375 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:13.764564 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:13.764967 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:13.764975 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:13.765225 (+ 250us) client_negotiation.cc:769] Sending connection context
0811 05:08:13.765419 (+ 194us) client_negotiation.cc:240] Negotiation successful
0811 05:08:13.765967 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":99,"thread_start_us":137,"threads_started":1}
I20260811 05:08:13.768743 14948 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:08:13 dist-test-slave-w206 krb5kdc[14769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for kudu/127.22.49.253@KRBTEST.COM
Aug 11 05:08:13 dist-test-slave-w206 krb5kdc[14769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.253@KRBTEST.COM for kudu/127.22.49.253@KRBTEST.COM
I20260811 05:08:13.775107 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.763221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:37905 (local address 127.0.0.1:57556)
0811 05:08:13.763429 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.763445 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:13.763532 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:13.764139 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:13.764142 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:13.764347 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:13.764518 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.764525 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.766109 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.766113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.767233 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.767247 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.768223 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.768227 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.768336 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.769147 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:13.769167 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:13.770757 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:13.773246 (+ 2489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:13.773252 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:13.773254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:13.773461 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:13.773820 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:13.773823 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:13.773825 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:13.773926 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:13.774457 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:13.774460 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:13.774568 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 05:08:13.774698 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 05:08:13.774857 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117}
I20260811 05:08:13.775945 14953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.763333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57556 (local address 127.22.49.253:37905)
0811 05:08:13.763778 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.763787 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.763808 (+ 21us) server_negotiation.cc:407] Connection header received
0811 05:08:13.763841 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.763845 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.764010 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.764156 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:13.764653 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.765959 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.767416 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.768063 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.768228 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.770910 (+ 2682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:13.770920 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:13.770934 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:13.770959 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:13.772867 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:13.773577 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:13.773584 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:13.773586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:13.773676 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:13.774023 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:13.774028 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:13.774030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:13.774337 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:13.774493 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:13.774829 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 05:08:13.774967 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":189,"threads_started":1}
I20260811 05:08:13.778273 14863 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:08:13.778430 14951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.769281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:37905 (local address 127.0.0.1:57570)
0811 05:08:13.769782 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.769797 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:13.769889 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:13.770135 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:13.770138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:13.770307 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:13.770410 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.770419 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.771306 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.771312 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.772169 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.772182 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.772739 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.772744 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.772860 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.773264 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:13.773275 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:13.774576 (+ 1301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:13.776698 (+ 2122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:13.776701 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:13.776702 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:13.776894 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:13.777241 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:13.777255 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:13.777257 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:13.777359 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:13.777746 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:13.777749 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:13.777850 (+ 101us) client_negotiation.cc:769] Sending connection context
0811 05:08:13.777961 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 05:08:13.778130 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445}
I20260811 05:08:13.778450 14954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.769372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57570 (local address 127.22.49.253:37905)
0811 05:08:13.769765 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.769774 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.769837 (+ 63us) server_negotiation.cc:407] Connection header received
0811 05:08:13.769994 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.769997 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.770033 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.770126 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:13.770525 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.771217 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.772349 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.772606 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.772691 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.774725 (+ 2034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:13.774729 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:13.774731 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:13.774753 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:13.776573 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:13.777020 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:13.777023 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:13.777025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:13.777118 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:13.777464 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:13.777466 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:13.777467 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:13.777628 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:13.777704 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:13.778066 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 05:08:13.778290 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":149,"threads_started":1}
I20260811 05:08:13.779100 14948 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:08:13.779181 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.778865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:36165 (local address 127.0.0.1:37870)
0811 05:08:13.779077 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.779123 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.252.keytab.
Entry for principal kudu/127.22.49.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.252.keytab.
I20260811 05:08:13.779762 14951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.779499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:36165 (local address 127.0.0.1:37878)
0811 05:08:13.779644 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.779715 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260811 05:08:13.779992 14886 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
I20260811 05:08:13.780107 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.779725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:36165 (local address 127.0.0.1:37890)
0811 05:08:13.779989 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.780045 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180}
I20260811 05:08:13.780647 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.252:36165
--webserver_interface=127.22.49.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.252.keytab
--principal=kudu/127.22.49.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:37597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:37293,127.22.49.253:37905,127.22.49.252:36165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:08:13.780839 14951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.780627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:36165 (local address 127.0.0.1:37904)
0811 05:08:13.780734 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.780779 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 05:08:13.781021 14948 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:36165: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
W20260811 05:08:13.782471 14863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:36165: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
I20260811 05:08:13.813658 14863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } attempt: 1
I20260811 05:08:13.814639 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.814261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:36165 (local address 127.0.0.1:37908)
0811 05:08:13.814460 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.814536 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 05:08:13.815513 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.815254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:36165 (local address 127.0.0.1:37924)
0811 05:08:13.815393 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.815448 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 05:08:13.815657 14863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:36165: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
I20260811 05:08:13.830291 14948 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } attempt: 1
I20260811 05:08:13.831243 14951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.830905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:36165 (local address 127.0.0.1:37940)
0811 05:08:13.831083 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.831155 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 05:08:13.832016 14951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.831784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:36165 (local address 127.0.0.1:37950)
0811 05:08:13.831901 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.831953 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 05:08:13.832162 14948 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:36165: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
I20260811 05:08:13.890828 14863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } attempt: 2
I20260811 05:08:13.891830 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.891438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:36165 (local address 127.0.0.1:37962)
0811 05:08:13.891634 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.891719 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 05:08:13.892634 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.892413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:36165 (local address 127.0.0.1:37976)
0811 05:08:13.892521 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.892572 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 05:08:13.892827 14863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:36165: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
W20260811 05:08:13.894845 14956 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 05:08:13.895203 14956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:13.895272 14956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:13.895344 14956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:13.899467 14956 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:13.899535 14956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:13.899583 14956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:13.899623 14956 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:13.899662 14956 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:13.900322 14948 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } attempt: 2
I20260811 05:08:13.901055 14951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.900761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:36165 (local address 127.0.0.1:37978)
0811 05:08:13.900913 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.900976 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 05:08:13.901808 14951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.901591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:36165 (local address 127.0.0.1:37986)
0811 05:08:13.901699 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.901748 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 05:08:13.901978 14948 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:36165: Network error: Client connection negotiation failed: client connection to 127.22.49.252:36165: connect: Connection refused (error 111)
I20260811 05:08:13.905524 14956 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:37597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:37293,127.22.49.253:37905,127.22.49.252:36165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.252.keytab
--principal=kudu/127.22.49.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.252:36165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.49.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:08:13.906631 14956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:13.907691 14956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:13.916173 14966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:13.916183 14963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:13.916177 14962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:13.916227 14956 server_base.cc:1034] running on GCE node
I20260811 05:08:13.917040 14956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:13.918121 14956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:13.919303 14956 hybrid_clock.cc:648] HybridClock initialized: now 1786424893919282 us; error 32 us; skew 500 ppm
Aug 11 05:08:13 dist-test-slave-w206 krb5kdc[14769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:13.922192 14956 init.cc:377] Logged in from keytab as kudu/127.22.49.252@KRBTEST.COM (short username kudu)
I20260811 05:08:13.923192 14956 webserver.cc:460] Webserver started at http://127.22.49.252:46411/ using document root <none> and password file <none>
I20260811 05:08:13.923748 14956 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:13.923874 14956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:13.924103 14956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:13.926170 14956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/data/instance:
uuid: "77694f3859c94472b06030f379474a19"
format_stamp: "Formatted at 2026-08-11 05:08:13 on dist-test-slave-w206"
server_key: "1246c714f0c5001f618d7ce7fe2223f4"
server_key_iv: "413e4b8a6d657610f5cbb6764e5ef0ea"
server_key_version: "encryptionkey@0"
I20260811 05:08:13.926770 14956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/wal/instance:
uuid: "77694f3859c94472b06030f379474a19"
format_stamp: "Formatted at 2026-08-11 05:08:13 on dist-test-slave-w206"
server_key: "1246c714f0c5001f618d7ce7fe2223f4"
server_key_iv: "413e4b8a6d657610f5cbb6764e5ef0ea"
server_key_version: "encryptionkey@0"
I20260811 05:08:13.930526 14956 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 05:08:13.933033 14975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:13.934262 14956 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 05:08:13.934408 14956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/wal
uuid: "77694f3859c94472b06030f379474a19"
format_stamp: "Formatted at 2026-08-11 05:08:13 on dist-test-slave-w206"
server_key: "1246c714f0c5001f618d7ce7fe2223f4"
server_key_iv: "413e4b8a6d657610f5cbb6764e5ef0ea"
server_key_version: "encryptionkey@0"
I20260811 05:08:13.934520 14956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:13.964164 14956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:13.967386 14956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:13.967605 14956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:13.974789 14956 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.252:36165
I20260811 05:08:13.975123 15034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.252:36165 every 8 connection(s)
I20260811 05:08:13.975834 14956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/data/info.pb
I20260811 05:08:13.978272 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 14956
I20260811 05:08:13.978371 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786424592714304-22727-0/minicluster-data/master-2/wal/instance
I20260811 05:08:13.978663 22727 external_mini_cluster.cc:1428] Setting key 386ced3edaef2a354ba756cdd40809de
I20260811 05:08:13.978754 15035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:13.983834 15035 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:08:13 dist-test-slave-w206 krb5kdc[14769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.252@KRBTEST.COM
Aug 11 05:08:13 dist-test-slave-w206 krb5kdc[14769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.252@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:08:13.991994 14863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } attempt: 3
I20260811 05:08:13.993177 14948 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } attempt: 3
I20260811 05:08:13.993407 15039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.980000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37998 (local address 127.22.49.252:36165)
0811 05:08:13.980389 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.980405 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.980440 (+ 35us) server_negotiation.cc:407] Connection header received
0811 05:08:13.981080 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.981094 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.981398 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.981658 (+ 260us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:13.982607 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.983655 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.984851 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.985342 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.985503 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.988175 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:13.988180 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:13.988189 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:13.988214 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:13.990108 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:13.990567 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:13.990576 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:13.990581 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:13.990713 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:13.991052 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:13.991056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:13.991058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:13.991626 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:13.991845 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:13.992102 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 05:08:13.992400 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":133,"threads_started":1}
I20260811 05:08:13.995285 14867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.985804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48200 (local address 127.22.49.254:37293)
0811 05:08:13.985977 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.985984 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.986251 (+ 267us) server_negotiation.cc:407] Connection header received
0811 05:08:13.986404 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.986407 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.986463 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.986518 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:13.987315 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.987869 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.988720 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.988938 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.989052 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.991178 (+ 2126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:13.991182 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:13.991185 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:13.991214 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:13.993275 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:13.993872 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:13.993877 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:13.993882 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:13.993973 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:13.994276 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:13.994280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:13.994281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:13.994505 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:13.994578 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:13.995015 (+ 437us) server_negotiation.cc:299] Negotiation successful
0811 05:08:13.995131 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 05:08:13.995812 15040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.985745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:37293 (local address 127.0.0.1:48200)
0811 05:08:13.986112 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.986159 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:13.986278 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:13.986665 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:13.986669 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:13.987065 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:13.987191 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.987197 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.987991 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.987995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.988595 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.988603 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.989054 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.989057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.989169 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.989611 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:13.989623 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:13.991039 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:13.993445 (+ 2406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:13.993455 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:13.993460 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:13.993767 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:13.994085 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:13.994088 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:13.994089 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:13.994172 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:13.994656 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:13.994662 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:13.994767 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 05:08:13.995421 (+ 654us) client_negotiation.cc:240] Negotiation successful
0811 05:08:13.995597 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":146,"threads_started":1}
I20260811 05:08:13.997447 15035 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 05:08:13 dist-test-slave-w206 krb5kdc[14769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for kudu/127.22.49.252@KRBTEST.COM
Aug 11 05:08:13 dist-test-slave-w206 krb5kdc[14769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.253@KRBTEST.COM for kudu/127.22.49.252@KRBTEST.COM
Aug 11 05:08:13 dist-test-slave-w206 krb5kdc[14769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:08:14.002709 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.992410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:36165 (local address 127.0.0.1:38006)
0811 05:08:13.992564 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.992581 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:13.992661 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:13.993259 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:13.993262 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:13.993437 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:13.993551 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.993559 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.994901 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.994907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.995678 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.995688 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.996586 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.996591 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.996680 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.997137 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:13.997152 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:13.998735 (+ 1583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:14.001045 (+ 2310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:14.001049 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:14.001053 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:14.001337 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:14.001682 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:14.001687 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:14.001690 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:14.001790 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:14.002225 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:14.002228 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:14.002330 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 05:08:14.002414 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 05:08:14.002547 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 05:08:14.003716 15041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.992646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38006 (local address 127.22.49.252:36165)
0811 05:08:13.992996 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.993005 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.993021 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:08:13.993060 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.993064 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.993110 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.993920 (+ 810us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:13.994016 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.994763 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.996104 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.996446 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.996894 (+ 448us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.998882 (+ 1988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:13.998887 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:13.998890 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:13.998918 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:14.000920 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.001461 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.001464 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.001466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.001570 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.001906 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.001909 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.001911 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.002118 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:14.003283 (+ 1165us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:14.003372 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 05:08:14.003492 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":104,"threads_started":1}
I20260811 05:08:14.004433 14951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.993596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:36165 (local address 127.0.0.1:38022)
0811 05:08:13.993776 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.993790 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:13.993868 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:13.994554 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:13.994557 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:13.994733 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:13.994841 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.994850 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.996794 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.996799 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.997703 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:13.997714 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.998404 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.998411 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:13.998503 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:13.999005 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:13.999020 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:14.000470 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:14.002606 (+ 2136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:14.002609 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:14.002612 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:14.002896 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:14.003265 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:14.003269 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:14.003271 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:14.003370 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:14.003884 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:14.003887 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:14.004011 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 05:08:14.004101 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 05:08:14.004234 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109}
I20260811 05:08:14.005036 15042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.994043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38022 (local address 127.22.49.252:36165)
0811 05:08:13.994285 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.994294 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.994307 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:08:13.994350 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.994355 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.994396 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.994955 (+ 559us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:13.995087 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.996670 (+ 1583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.997896 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.998258 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.998721 (+ 463us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:14.000594 (+ 1873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:14.000599 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:14.000604 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:14.000631 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:14.002468 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.003052 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.003058 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.003063 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.003149 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.003499 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.003502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.003504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.003743 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:14.004621 (+ 878us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:14.004704 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 05:08:14.004837 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":86,"threads_started":1}
Aug 11 05:08:14 dist-test-slave-w206 krb5kdc[14769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.252@KRBTEST.COM for kudu/127.22.49.253@KRBTEST.COM
I20260811 05:08:14.008033 14863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56: Bootstrap starting.
I20260811 05:08:14.008033 14948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05: Bootstrap starting.
I20260811 05:08:14.010442 15040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.998013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:37905 (local address 127.0.0.1:57572)
0811 05:08:13.998517 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:13.998530 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:13.998644 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:13.999679 (+ 1035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:13.999686 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:14.000264 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:14.000374 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:14.000381 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.002158 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.002164 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:14.003229 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:14.003241 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.004838 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.004840 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:14.004904 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:14.005309 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:14.005323 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:14.006745 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:14.008785 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:14.008788 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:14.008790 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:14.009032 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:14.009358 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:14.009362 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:14.009364 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:14.009465 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:14.009937 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:14.009940 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:14.010035 (+ 95us) client_negotiation.cc:769] Sending connection context
0811 05:08:14.010149 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 05:08:14.010284 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439}
I20260811 05:08:14.010471 14954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.998264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57572 (local address 127.22.49.253:37905)
0811 05:08:13.998372 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.998376 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.998581 (+ 205us) server_negotiation.cc:407] Connection header received
0811 05:08:13.999122 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.999126 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.999185 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.999517 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.000773 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.002032 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.003364 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.004427 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.004506 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:14.006903 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:14.006910 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:14.006916 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:14.006946 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:14.008654 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.009140 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.009144 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.009146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.009245 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.009569 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.009572 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.009575 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.009813 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:14.009924 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:14.010215 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 05:08:14.010334 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 05:08:14.010793 14948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:14.010823 14863 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:14.011646 14948 log.cc:824] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:14.011746 14863 log.cc:824] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:14.011893 15035 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:08:14.013845 14948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05: No bootstrap required, opened a new log
I20260811 05:08:14.014362 14867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:13.996312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48216 (local address 127.22.49.254:37293)
0811 05:08:13.996419 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:13.996423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:13.996488 (+ 65us) server_negotiation.cc:407] Connection header received
0811 05:08:13.996635 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:13.996638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:13.996677 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:13.996725 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:13.997601 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.998377 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:13.999587 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:13.999982 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.000061 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:14.003106 (+ 3045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:14.003113 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:14.003118 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:14.003141 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:14.004891 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.012878 (+ 7987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.012882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.012884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.012981 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.013327 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.013330 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.013332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.013560 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:14.013806 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:14.014082 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 05:08:14.014221 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 05:08:14 dist-test-slave-w206 krb5kdc[14769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.252@KRBTEST.COM for kudu/127.22.49.252@KRBTEST.COM
I20260811 05:08:14.018018 14948 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } }
I20260811 05:08:14.018280 14948 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8811c45484184b41917d362aac60cc05, State: Initialized, Role: FOLLOWER
I20260811 05:08:14.018664 14948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } }
I20260811 05:08:14.019523 15045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } } }
I20260811 05:08:14.019816 15045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:14.020354 14948 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 05:08:14 dist-test-slave-w206 krb5kdc[14769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.253@KRBTEST.COM
I20260811 05:08:14.021696 15040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:14.012402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:36165 (local address 127.0.0.1:38036)
0811 05:08:14.012590 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:14.012603 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:14.012700 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:14.013043 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:14.013045 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:14.013219 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:14.013326 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:14.013333 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.014347 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.014350 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:14.015150 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:14.015161 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.015929 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.015933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:14.016005 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:14.016494 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:14.016512 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:14.018006 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:14.020094 (+ 2088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:14.020097 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:14.020099 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:14.020324 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:14.020603 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:14.020605 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:14.020607 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:14.020687 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:14.021151 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:14.021154 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:14.021245 (+ 91us) client_negotiation.cc:769] Sending connection context
0811 05:08:14.021353 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 05:08:14.021480 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138}
I20260811 05:08:14.022184 15042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:14.012426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38036 (local address 127.22.49.252:36165)
0811 05:08:14.012522 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.012527 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.012789 (+ 262us) server_negotiation.cc:407] Connection header received
0811 05:08:14.012823 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.012829 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.012876 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.012942 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.013443 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.014205 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.015285 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.015712 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.015815 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:14.018151 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:14.018154 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:14.018157 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:14.018179 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:14.019980 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.020434 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.020437 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.020439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.020515 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.020793 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.020800 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.020805 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.021027 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:14.021141 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:14.021919 (+ 778us) server_negotiation.cc:299] Negotiation successful
0811 05:08:14.022042 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 05:08:14.024698 14863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56: No bootstrap required, opened a new log
I20260811 05:08:14.025616 15035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19: Bootstrap starting.
I20260811 05:08:14.025806 14954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:14.015650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57580 (local address 127.22.49.253:37905)
0811 05:08:14.015745 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.015752 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.015810 (+ 58us) server_negotiation.cc:407] Connection header received
0811 05:08:14.015921 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.015925 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.015962 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.016053 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.016797 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.017452 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.018385 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.018782 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.018858 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:14.021915 (+ 3057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:14.021919 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:14.021921 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:14.021945 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:14.023844 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.024355 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.024358 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.024360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.024450 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.024783 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.024787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.024788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.024993 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:14.025164 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:14.025553 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 05:08:14.025672 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260811 05:08:14.025933 15058 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:08:14.025997 15058 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:08:14.028378 15035 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:14.029270 15035 log.cc:824] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:14.029580 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:08:14.031114 14837 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c107d38beeda485b83c7225eacf08a56"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48216
I20260811 05:08:14.031818 15035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19: No bootstrap required, opened a new log
I20260811 05:08:14.028867 14870 master_runner.cc:186] Error getting master registration for 127.22.49.254:37293: OK, instance_id { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" instance_seqno: 1786424893516143 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 05:08:14.032178 14870 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 05:08:14.034124 14863 raft_consensus.cc:348] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } }
I20260811 05:08:14.034348 14863 raft_consensus.cc:729] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c107d38beeda485b83c7225eacf08a56, State: Initialized, Role: FOLLOWER
I20260811 05:08:14.034677 14863 consensus_queue.cc:260] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } }
I20260811 05:08:14.035310 15061 sys_catalog.cc:455] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } } }
I20260811 05:08:14.035537 15061 sys_catalog.cc:458] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:14.036156 14863 sys_catalog.cc:564] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:14.036209 14837 raft_consensus.cc:482] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 05:08:14.036339 14837 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:14.036522 15035 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } }
I20260811 05:08:14.036736 15035 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77694f3859c94472b06030f379474a19, State: Initialized, Role: FOLLOWER
I20260811 05:08:14.037045 15035 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } }
I20260811 05:08:14.037819 14837 raft_consensus.cc:504] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } }
I20260811 05:08:14.038652 15035 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:14.038820 14837 leader_election.cc:288] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [CANDIDATE]: Term 1 election: Requested vote from peers 8811c45484184b41917d362aac60cc05 (127.22.49.253:37905), 77694f3859c94472b06030f379474a19 (127.22.49.252:36165)
I20260811 05:08:14.039644 14915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c107d38beeda485b83c7225eacf08a56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8811c45484184b41917d362aac60cc05"
I20260811 05:08:14.039908 14915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:14.040385 15007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c107d38beeda485b83c7225eacf08a56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "77694f3859c94472b06030f379474a19"
I20260811 05:08:14.040614 15007 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:14.041301 14915 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c107d38beeda485b83c7225eacf08a56 in term 1.
I20260811 05:08:14.041735 14802 leader_election.cc:302] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8811c45484184b41917d362aac60cc05, c107d38beeda485b83c7225eacf08a56; no voters:
I20260811 05:08:14.042021 15061 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:14.042012 15007 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c107d38beeda485b83c7225eacf08a56 in term 1.
I20260811 05:08:14.042230 15061 raft_consensus.cc:686] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [term 1 LEADER]: Becoming Leader. State: Replica: c107d38beeda485b83c7225eacf08a56, State: Running, Role: LEADER
I20260811 05:08:14.043385 15068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } } }
I20260811 05:08:14.043519 15068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:14.045791 15061 consensus_queue.cc:237] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } }
I20260811 05:08:14.047366 14785 master_runner.cc:263] No leader master found from master c107d38beeda485b83c7225eacf08a56
I20260811 05:08:14.047441 14785 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 05:08:14.047799 15090 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:08:14.047927 15090 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260811 05:08:14.050582 15074 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:08:14.050665 15074 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:08:14.051404 15061 sys_catalog.cc:455] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c107d38beeda485b83c7225eacf08a56. Latest consensus state: current_term: 1 leader_uuid: "c107d38beeda485b83c7225eacf08a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } } }
I20260811 05:08:14.051519 15061 sys_catalog.cc:458] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:14.054870 15103 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:14.055807 15103 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:14.061033 15007 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19 [term 1 FOLLOWER]: Refusing update from remote peer c107d38beeda485b83c7225eacf08a56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:14.061786 15089 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:14.065937 15068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c107d38beeda485b83c7225eacf08a56. Latest consensus state: current_term: 1 leader_uuid: "c107d38beeda485b83c7225eacf08a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } } }
I20260811 05:08:14.066061 15068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:14.067116 14915 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05 [term 1 FOLLOWER]: Refusing update from remote peer c107d38beeda485b83c7225eacf08a56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:14.067709 15089 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:14.071416 15045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c107d38beeda485b83c7225eacf08a56. Latest consensus state: current_term: 1 leader_uuid: "c107d38beeda485b83c7225eacf08a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } } }
I20260811 05:08:14.071540 15045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:14.076714 15089 sys_catalog.cc:455] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c107d38beeda485b83c7225eacf08a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } } }
I20260811 05:08:14.076843 15089 sys_catalog.cc:458] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:14.077852 15045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c107d38beeda485b83c7225eacf08a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } } }
I20260811 05:08:14.077973 15045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:14.078342 15104 mvcc.cc:205] Tried to move back new op lower bound from 7317196366067482624 to 7317196366014980096. Current Snapshot: MvccSnapshot[applied={T|T < 7317196366067482624}]
I20260811 05:08:14.080367 15107 mvcc.cc:205] Tried to move back new op lower bound from 7317196366067482624 to 7317196366014980096. Current Snapshot: MvccSnapshot[applied={T|T < 7317196366067482624}]
I20260811 05:08:14.081064 15061 sys_catalog.cc:455] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c107d38beeda485b83c7225eacf08a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } } }
I20260811 05:08:14.081182 15061 sys_catalog.cc:458] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:14.082204 15068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c107d38beeda485b83c7225eacf08a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c107d38beeda485b83c7225eacf08a56" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 37293 } } peers { permanent_uuid: "8811c45484184b41917d362aac60cc05" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 37905 } } peers { permanent_uuid: "77694f3859c94472b06030f379474a19" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 36165 } } }
I20260811 05:08:14.082335 15068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:14.086201 15105 mvcc.cc:205] Tried to move back new op lower bound from 7317196366067482624 to 7317196366014980096. Current Snapshot: MvccSnapshot[applied={T|T < 7317196366067482624}]
I20260811 05:08:14.087114 15103 catalog_manager.cc:1347] Generated new cluster ID: dfeb8cec52b64cda9ef95ef192967588
I20260811 05:08:14.087182 15103 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:14.088937 14867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:14.048650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48228 (local address 127.22.49.254:37293)
0811 05:08:14.048773 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.048778 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.052049 (+ 3271us) server_negotiation.cc:407] Connection header received
0811 05:08:14.052254 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.052257 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.052319 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.052373 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.063082 (+ 10709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.063943 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.069791 (+ 5848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.070155 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.070232 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:14.078233 (+ 8001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:14.078237 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:14.078240 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:14.078291 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:14.080037 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.085240 (+ 5203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.085245 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.085247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.085356 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.086038 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.086042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.086044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.086289 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:14.086412 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:14.088496 (+ 2084us) server_negotiation.cc:299] Negotiation successful
0811 05:08:14.088631 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 05:08:14.089967 14954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:14.048275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57594 (local address 127.22.49.253:37905)
0811 05:08:14.048412 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.048418 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.053852 (+ 5434us) server_negotiation.cc:407] Connection header received
0811 05:08:14.055623 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.055627 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.055677 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.055730 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.065830 (+ 10100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.066596 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.072663 (+ 6067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.073024 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.073100 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:14.082656 (+ 9556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:14.082660 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:14.082663 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:14.082690 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:14.084423 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.085659 (+ 1236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.085662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.085664 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.085744 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.087155 (+ 1411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.087161 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.087165 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.087407 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:14.087519 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:14.089537 (+ 2018us) server_negotiation.cc:299] Negotiation successful
0811 05:08:14.089732 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 05:08:14.092794 15042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:14.047811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38044 (local address 127.22.49.252:36165)
0811 05:08:14.047931 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.047938 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.053642 (+ 5704us) server_negotiation.cc:407] Connection header received
0811 05:08:14.054045 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.054049 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.054097 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.054148 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.067783 (+ 13635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.068646 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.075069 (+ 6423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:14.075430 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:14.075507 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:14.080583 (+ 5076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:14.080587 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:14.080590 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:14.080619 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:14.082479 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.086491 (+ 4012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.086495 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.086497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.086585 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:14.087808 (+ 1223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:14.087811 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:14.087813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:14.088022 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:14.088152 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:14.092506 (+ 4354us) server_negotiation.cc:299] Negotiation successful
0811 05:08:14.092637 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 05:08:14.104044 15103 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:14.105291 15103 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:14.122488 15103 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c107d38beeda485b83c7225eacf08a56: Generated new TSK 0
I20260811 05:08:14.123495 15103 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 05:08:14.154568 14867 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:14.151930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48236 (local address 127.22.49.254:37293)
0811 05:08:14.152064 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.152068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.153407 (+ 1339us) server_negotiation.cc:407] Connection header received
0811 05:08:14.153608 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.153611 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.153665 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.153718 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.154420 (+ 702us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48236: BlockingRecv error: recv got EOF from 127.0.0.1:48236 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260811 05:08:14.156046 14954 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:14.152787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57596 (local address 127.22.49.253:37905)
0811 05:08:14.152907 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.152912 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.155122 (+ 2210us) server_negotiation.cc:407] Connection header received
0811 05:08:14.155318 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.155322 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.155376 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.155428 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.155930 (+ 502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57596: BlockingRecv error: recv got EOF from 127.0.0.1:57596 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 05:08:14.158089 15042 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:14.156577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38054 (local address 127.22.49.252:36165)
0811 05:08:14.156690 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.156695 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.157160 (+ 465us) server_negotiation.cc:407] Connection header received
0811 05:08:14.157352 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.157355 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.157408 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.157459 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.157959 (+ 500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38054: BlockingRecv error: recv got EOF from 127.0.0.1:38054 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 05:08:14.163043 14954 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:14.161333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57610 (local address 127.22.49.253:37905)
0811 05:08:14.161454 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.161458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.161948 (+ 490us) server_negotiation.cc:407] Connection header received
0811 05:08:14.162179 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.162182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.162276 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.162333 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.162903 (+ 570us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57610: BlockingRecv error: recv got EOF from 127.0.0.1:57610 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 05:08:14.168538 14954 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:14.166842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57618 (local address 127.22.49.253:37905)
0811 05:08:14.166947 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.166951 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.167562 (+ 611us) server_negotiation.cc:407] Connection header received
0811 05:08:14.167751 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.167755 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.167809 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.167866 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.168427 (+ 561us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57618: BlockingRecv error: recv got EOF from 127.0.0.1:57618 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260811 05:08:14.174422 14954 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:14.172814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57630 (local address 127.22.49.253:37905)
0811 05:08:14.172919 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.172924 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.173481 (+ 557us) server_negotiation.cc:407] Connection header received
0811 05:08:14.173673 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.173676 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.173726 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.173777 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.174305 (+ 528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57630: BlockingRecv error: recv got EOF from 127.0.0.1:57630 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260811 05:08:14.182583 14954 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:14.180904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57646 (local address 127.22.49.253:37905)
0811 05:08:14.181055 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.181059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.181602 (+ 543us) server_negotiation.cc:407] Connection header received
0811 05:08:14.181799 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.181803 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.181857 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.181911 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.182468 (+ 557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57646: BlockingRecv error: recv got EOF from 127.0.0.1:57646 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260811 05:08:14.195072 14954 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:14.193240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57662 (local address 127.22.49.253:37905)
0811 05:08:14.193363 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.193367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.193969 (+ 602us) server_negotiation.cc:407] Connection header received
0811 05:08:14.194190 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.194194 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.194250 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.194307 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.194924 (+ 617us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57662: BlockingRecv error: recv got EOF from 127.0.0.1:57662 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 05:08:14.215960 14954 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:14.214042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57668 (local address 127.22.49.253:37905)
0811 05:08:14.214183 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.214188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.214815 (+ 627us) server_negotiation.cc:407] Connection header received
0811 05:08:14.215101 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.215105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.215163 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.215222 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.215834 (+ 612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57668: BlockingRecv error: recv got EOF from 127.0.0.1:57668 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 05:08:14.252002 14954 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:14.250604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57674 (local address 127.22.49.253:37905)
0811 05:08:14.250726 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.250731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.251025 (+ 294us) server_negotiation.cc:407] Connection header received
0811 05:08:14.251196 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.251199 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.251264 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.251367 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.251874 (+ 507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57674: BlockingRecv error: recv got EOF from 127.0.0.1:57674 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260811 05:08:14.319065 14954 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:14.317981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57684 (local address 127.22.49.253:37905)
0811 05:08:14.318154 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.318158 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.318216 (+ 58us) server_negotiation.cc:407] Connection header received
0811 05:08:14.318346 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.318348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.318396 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.318469 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.318907 (+ 438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57684: BlockingRecv error: recv got EOF from 127.0.0.1:57684 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260811 05:08:14.450371 14954 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:14.449229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57698 (local address 127.22.49.253:37905)
0811 05:08:14.449399 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.449403 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.449447 (+ 44us) server_negotiation.cc:407] Connection header received
0811 05:08:14.449568 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.449571 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.449621 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.449698 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.450203 (+ 505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57698: BlockingRecv error: recv got EOF from 127.0.0.1:57698 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260811 05:08:14.709523 14954 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:14.708551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57706 (local address 127.22.49.253:37905)
0811 05:08:14.708687 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:14.708690 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:14.708705 (+ 15us) server_negotiation.cc:407] Connection header received
0811 05:08:14.708826 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:14.708829 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:14.708875 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:14.708950 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:14.709425 (+ 475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57706: BlockingRecv error: recv got EOF from 127.0.0.1:57706 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:08:15.027505 15058 catalog_manager.cc:1259] Loaded cluster ID: dfeb8cec52b64cda9ef95ef192967588
I20260811 05:08:15.027588 15058 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05: loading cluster ID for follower catalog manager: success
I20260811 05:08:15.029286 15058 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05: acquiring CA information for follower catalog manager: success
I20260811 05:08:15.030458 15058 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8811c45484184b41917d362aac60cc05: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 05:08:15.049405 15090 catalog_manager.cc:1259] Loaded cluster ID: dfeb8cec52b64cda9ef95ef192967588
I20260811 05:08:15.049503 15090 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19: loading cluster ID for follower catalog manager: success
I20260811 05:08:15.051286 15090 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19: acquiring CA information for follower catalog manager: success
I20260811 05:08:15.052493 15090 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 77694f3859c94472b06030f379474a19: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 05:08:15.227947 15184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:15.223830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57720 (local address 127.22.49.253:37905)
0811 05:08:15.224061 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:15.224064 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:15.224082 (+ 18us) server_negotiation.cc:407] Connection header received
0811 05:08:15.224190 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:15.224193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:15.224329 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:15.224446 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:15.224689 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:15.225293 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:15.226171 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:15.226439 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:15.226539 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:15.226834 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:15.227335 (+ 501us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:15.227449 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:15.227655 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 05:08:15.227750 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":87,"threads_started":1}
I20260811 05:08:15.236316 15192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:15.232249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38060 (local address 127.22.49.252:36165)
0811 05:08:15.232556 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:15.232560 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:15.232573 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:08:15.232655 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:15.232657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:15.232828 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:15.232969 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:15.233231 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:15.233795 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:15.234666 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:15.234911 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:15.235064 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:15.235393 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:15.235900 (+ 507us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:15.236038 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:15.236083 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 05:08:15.236152 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":105,"threads_started":1}
I20260811 05:08:15.246183 15184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:15.240289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57730 (local address 127.22.49.253:37905)
0811 05:08:15.240440 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:15.240445 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:15.241585 (+ 1140us) server_negotiation.cc:407] Connection header received
0811 05:08:15.241781 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:15.241785 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:15.241845 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:15.241898 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:15.242436 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:15.243403 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:15.244653 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:15.245020 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:15.245127 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:15.245556 (+ 429us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:15.245671 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:15.245724 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:15.245933 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 05:08:15.246009 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 05:08:15.247561 15200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:15.240605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48250 (local address 127.22.49.254:37293)
0811 05:08:15.241264 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:15.241269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:15.241444 (+ 175us) server_negotiation.cc:407] Connection header received
0811 05:08:15.241620 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:15.241624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:15.241790 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:15.241910 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:15.242398 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:15.243282 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:15.244207 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:15.245264 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:15.245356 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:15.245885 (+ 529us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:15.246722 (+ 837us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:15.246821 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:15.247297 (+ 476us) server_negotiation.cc:299] Negotiation successful
0811 05:08:15.247369 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":100,"threads_started":1}
I20260811 05:08:15.248338 15192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:15.240302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38070 (local address 127.22.49.252:36165)
0811 05:08:15.240416 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:15.240422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:15.240647 (+ 225us) server_negotiation.cc:407] Connection header received
0811 05:08:15.240879 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:15.240883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:15.240937 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:15.241016 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:15.241311 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:15.242146 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:15.246718 (+ 4572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:15.247105 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:15.247211 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:15.247574 (+ 363us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:15.247660 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:15.247733 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:15.248122 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 05:08:15.248208 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 05:08:15.252040 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 14785
I20260811 05:08:15.262656 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 14870
I20260811 05:08:15.274248 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 14956
2026-08-11T05:08:15Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3185 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 05:08:15 dist-test-slave-w206 krb5kdc[15204](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 05:08:15 dist-test-slave-w206 krb5kdc[15204](info): set up 2 sockets
Aug 11 05:08:15 dist-test-slave-w206 krb5kdc[15204](info): commencing operation
krb5kdc: starting...
W20260811 05:08:16.389189 22727 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/test-user.keytab.
Aug 11 05:08:16 dist-test-slave-w206 krb5kdc[15204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T05:08:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T05:08:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.49.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
Entry for principal kudu/127.22.49.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab.
I20260811 05:08:16.522135 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:39843
--webserver_interface=127.22.49.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:39445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:39843,127.22.49.253:33215,127.22.49.252:46855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 05:08:16.637130 15219 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 05:08:16.637455 15219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:16.637483 15219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:16.637591 15219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:16.642313 15219 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:16.642395 15219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:16.642418 15219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:16.642437 15219 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:16.642454 15219 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:16.648317 15219 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:39445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:39843,127.22.49.253:33215,127.22.49.252:46855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.254.keytab
--principal=kudu/127.22.49.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.254:39843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.49.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:08:16.649441 15219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:16.650506 15219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:16.659360 15225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:16.659341 15224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:16.659340 15227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:16.659425 15219 server_base.cc:1034] running on GCE node
I20260811 05:08:16.660399 15219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:16.661531 15219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:16.662786 15219 hybrid_clock.cc:648] HybridClock initialized: now 1786424896662765 us; error 37 us; skew 500 ppm
Aug 11 05:08:16 dist-test-slave-w206 krb5kdc[15204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:16.665920 15219 init.cc:377] Logged in from keytab as kudu/127.22.49.254@KRBTEST.COM (short username kudu)
I20260811 05:08:16.666889 15219 webserver.cc:460] Webserver started at http://127.22.49.254:40095/ using document root <none> and password file <none>
I20260811 05:08:16.667503 15219 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:16.667570 15219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:16.667740 15219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:16.669865 15219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/data/instance:
uuid: "1fdeddfa5e504bc9aed7642b5b48cf85"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-w206"
server_key: "65d50b4b811d98fcb186ff1ee8e36e5e"
server_key_iv: "dc15fe52f4690004673ff7073fbc79e4"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.670415 15219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/wal/instance:
uuid: "1fdeddfa5e504bc9aed7642b5b48cf85"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-w206"
server_key: "65d50b4b811d98fcb186ff1ee8e36e5e"
server_key_iv: "dc15fe52f4690004673ff7073fbc79e4"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.674204 15219 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 05:08:16.676635 15235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:16.677891 15219 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 05:08:16.678016 15219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/wal
uuid: "1fdeddfa5e504bc9aed7642b5b48cf85"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-w206"
server_key: "65d50b4b811d98fcb186ff1ee8e36e5e"
server_key_iv: "dc15fe52f4690004673ff7073fbc79e4"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.678108 15219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:16.696225 15219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:16.699429 15219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:16.699594 15219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:16.706846 15219 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.254:39843
I20260811 05:08:16.707150 15291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.254:39843 every 8 connection(s)
I20260811 05:08:16.707924 15219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/data/info.pb
I20260811 05:08:16.709472 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 15219
I20260811 05:08:16.709605 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-0/wal/instance
I20260811 05:08:16.709923 22727 external_mini_cluster.cc:1428] Setting key 4fff2161ab37b2d69bacd534c2c94474
I20260811 05:08:16.711303 15292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:16.715417 15292 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.49.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.253@KRBTEST.COM" created.
Aug 11 05:08:16 dist-test-slave-w206 krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:08:16.733217 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.717912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39843 (local address 127.0.0.1:54620)
0811 05:08:16.718561 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.718610 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:16.719510 (+ 900us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:16.720394 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:16.720398 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:16.720724 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:16.721133 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:16.721150 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.722722 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.722729 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:16.723568 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:16.723579 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.724374 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.724378 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:16.724495 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:16.725115 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:16.725146 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:16.727216 (+ 2070us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:16.729966 (+ 2750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:16.729975 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:16.729985 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:16.730222 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:16.730569 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:16.730573 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:16.730575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:16.730693 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:16.731448 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:16.731454 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:16.731591 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 05:08:16.731761 (+ 170us) client_negotiation.cc:240] Negotiation successful
0811 05:08:16.732180 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"mutex_wait_us":110,"spinlock_wait_cycles":57600,"thread_start_us":162,"threads_started":1}
I20260811 05:08:16.733217 15295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.717912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54620 (local address 127.22.49.254:39843)
0811 05:08:16.718485 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:16.718510 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:16.718751 (+ 241us) server_negotiation.cc:407] Connection header received
0811 05:08:16.719856 (+ 1105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:16.719864 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:16.720162 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:16.720398 (+ 236us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:16.721347 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.722516 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.723770 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.724181 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.724390 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:16.727414 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:16.727420 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:16.727432 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:16.727458 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:16.729817 (+ 2359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.730358 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.730362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.730363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.730470 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.730792 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.730795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.730797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.731303 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:16.731453 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:16.731837 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 05:08:16.732129 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":373,"thread_start_us":153,"threads_started":1}
I20260811 05:08:16.736048 15292 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:08:16.736768 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.736516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:33215 (local address 127.0.0.1:44136)
0811 05:08:16.736637 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.736706 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:33215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 05:08:16.736986 15236 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.49.253:33215: connect: Connection refused (error 111)
I20260811 05:08:16.737812 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.737605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:33215 (local address 127.0.0.1:44150)
0811 05:08:16.737710 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.737759 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:33215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 05:08:16.737953 15292 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.253:33215: Network error: Client connection negotiation failed: client connection to 127.22.49.253:33215: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.253.keytab.
Entry for principal kudu/127.22.49.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.253.keytab.
I20260811 05:08:16.742352 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.253:33215
--webserver_interface=127.22.49.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.253.keytab
--principal=kudu/127.22.49.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:39445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:39843,127.22.49.253:33215,127.22.49.252:46855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:08:16.787209 15292 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } attempt: 1
I20260811 05:08:16.788113 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.787809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:33215 (local address 127.0.0.1:44152)
0811 05:08:16.787969 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.788033 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:33215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 05:08:16.788913 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.788665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:33215 (local address 127.0.0.1:44162)
0811 05:08:16.788778 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.788830 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:33215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 05:08:16.789083 15292 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.253:33215: Network error: Client connection negotiation failed: client connection to 127.22.49.253:33215: connect: Connection refused (error 111)
I20260811 05:08:16.857275 15292 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } attempt: 2
I20260811 05:08:16.858129 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.857837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:33215 (local address 127.0.0.1:44170)
0811 05:08:16.857990 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.858053 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:33215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 05:08:16.858893 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.858686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:33215 (local address 127.0.0.1:44172)
0811 05:08:16.858774 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.858817 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.253:33215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 05:08:16.859061 15292 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.253:33215: Network error: Client connection negotiation failed: client connection to 127.22.49.253:33215: connect: Connection refused (error 111)
W20260811 05:08:16.859102 15299 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 05:08:16.859368 15299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:16.859398 15299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:16.859441 15299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 05:08:16.863406 15299 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:16.863458 15299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:16.863476 15299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:16.863493 15299 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:16.863508 15299 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:16.868723 15299 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:39445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:39843,127.22.49.253:33215,127.22.49.252:46855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.253.keytab
--principal=kudu/127.22.49.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.253:33215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.49.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:08:16.869710 15299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:16.870646 15299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:16.879139 15308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:16.879098 15305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:16.879241 15306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:16.879112 15299 server_base.cc:1034] running on GCE node
I20260811 05:08:16.879915 15299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:16.880996 15299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:16.882264 15299 hybrid_clock.cc:648] HybridClock initialized: now 1786424896882246 us; error 29 us; skew 500 ppm
Aug 11 05:08:16 dist-test-slave-w206 krb5kdc[15204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:16.885030 15299 init.cc:377] Logged in from keytab as kudu/127.22.49.253@KRBTEST.COM (short username kudu)
I20260811 05:08:16.885951 15299 webserver.cc:460] Webserver started at http://127.22.49.253:36545/ using document root <none> and password file <none>
I20260811 05:08:16.886499 15299 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:16.886560 15299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:16.886818 15299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:16.888983 15299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/data/instance:
uuid: "210a2909ddb94ccc9f800acab9b069bb"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-w206"
server_key: "34ebf45240d32d192d2d7c96d6672b7a"
server_key_iv: "dd6ab97ba44c1dbe9afdbacfcf477eb0"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.889611 15299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/wal/instance:
uuid: "210a2909ddb94ccc9f800acab9b069bb"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-w206"
server_key: "34ebf45240d32d192d2d7c96d6672b7a"
server_key_iv: "dd6ab97ba44c1dbe9afdbacfcf477eb0"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.893528 15299 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:08:16.896123 15315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:16.897382 15299 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 05:08:16.897544 15299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/wal
uuid: "210a2909ddb94ccc9f800acab9b069bb"
format_stamp: "Formatted at 2026-08-11 05:08:16 on dist-test-slave-w206"
server_key: "34ebf45240d32d192d2d7c96d6672b7a"
server_key_iv: "dd6ab97ba44c1dbe9afdbacfcf477eb0"
server_key_version: "encryptionkey@0"
I20260811 05:08:16.897666 15299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:16.918550 15299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:16.921864 15299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:16.922089 15299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:16.929802 15299 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.253:33215
I20260811 05:08:16.930116 15382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.253:33215 every 8 connection(s)
I20260811 05:08:16.930897 15299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/data/info.pb
I20260811 05:08:16.933750 15383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:16.937445 15383 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:08:16.939813 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 15299
I20260811 05:08:16.939949 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-1/wal/instance
I20260811 05:08:16.940258 22727 external_mini_cluster.cc:1428] Setting key 1ec1de786af90733070756bcfc4d0150
Aug 11 05:08:16 dist-test-slave-w206 krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.253@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.49.252@KRBTEST.COM; defaulting to no policy
I20260811 05:08:16.950239 15292 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.49.252@KRBTEST.COM" created.
I20260811 05:08:16.953800 15295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.939333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54636 (local address 127.22.49.254:39843)
0811 05:08:16.939501 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:16.939505 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:16.940442 (+ 937us) server_negotiation.cc:407] Connection header received
0811 05:08:16.941836 (+ 1394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:16.941839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:16.941895 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:16.941982 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:16.943354 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.944075 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.945894 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.946169 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.946280 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:16.949386 (+ 3106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:16.949389 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:16.949392 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:16.949419 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:16.951297 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.951871 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.951874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.951877 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.951964 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.952445 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.952447 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.952448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.952688 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:16.952796 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:16.953496 (+ 700us) server_negotiation.cc:299] Negotiation successful
0811 05:08:16.953619 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 05:08:16.955462 15385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.939659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39843 (local address 127.0.0.1:54636)
0811 05:08:16.940250 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.940311 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:16.941549 (+ 1238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:16.942173 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:16.942184 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:16.942676 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:16.943203 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:16.943218 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.944215 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.944222 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:16.945735 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:16.945751 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.946351 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.946358 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:16.946610 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:16.947357 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:16.947382 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:16.949179 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:16.951397 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:16.951402 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:16.951417 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:16.951777 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:16.952069 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:16.952072 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:16.952073 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:16.952287 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:16.952796 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:16.952804 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:16.953172 (+ 368us) client_negotiation.cc:769] Sending connection context
0811 05:08:16.953437 (+ 265us) client_negotiation.cc:240] Negotiation successful
0811 05:08:16.953807 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":167,"threads_started":1}
Aug 11 05:08:16 dist-test-slave-w206 krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for kudu/127.22.49.253@KRBTEST.COM
I20260811 05:08:16.957793 15383 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:08:16.961143 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.950746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:33215 (local address 127.0.0.1:44186)
0811 05:08:16.951003 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.951019 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:16.951100 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:16.951742 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:16.951745 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:16.951931 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:16.952066 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:16.952073 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.953373 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.953377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:16.954129 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:16.954139 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.954899 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.954903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:16.955032 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:16.955525 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:16.955540 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:16.956888 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:16.959532 (+ 2644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:16.959535 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:16.959537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:16.959734 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:16.960071 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:16.960074 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:16.960076 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:16.960163 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:16.960608 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:16.960612 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:16.960710 (+ 98us) client_negotiation.cc:769] Sending connection context
0811 05:08:16.960830 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 05:08:16.960972 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260811 05:08:16.961272 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.950908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44186 (local address 127.22.49.253:33215)
0811 05:08:16.951291 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:16.951304 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:16.951334 (+ 30us) server_negotiation.cc:407] Connection header received
0811 05:08:16.951396 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:16.951402 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:16.951605 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:16.951766 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:16.952170 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.953250 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.954250 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.954699 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.954878 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:16.957049 (+ 2171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:16.957056 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:16.957068 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:16.957092 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:16.959418 (+ 2326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.959855 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.959860 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.959862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.959955 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.960256 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.960261 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.960263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.960501 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:16.960643 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:16.960937 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 05:08:16.961075 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":182,"threads_started":1}
I20260811 05:08:16.963506 15292 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:08:16.964223 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.963982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:46855 (local address 127.0.0.1:44006)
0811 05:08:16.964100 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.964153 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 05:08:16.964896 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.964645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:46855 (local address 127.0.0.1:44018)
0811 05:08:16.964782 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.964833 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260811 05:08:16.965054 15292 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:46855: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
Aug 11 05:08:16 dist-test-slave-w206 krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.253@KRBTEST.COM for kudu/127.22.49.253@KRBTEST.COM
I20260811 05:08:16.969136 15389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.958401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44202 (local address 127.22.49.253:33215)
0811 05:08:16.958757 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:16.958766 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:16.958779 (+ 13us) server_negotiation.cc:407] Connection header received
0811 05:08:16.958812 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:16.958814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:16.958856 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:16.958948 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:16.959592 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.960502 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.962085 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.962435 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.962571 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:16.965892 (+ 3321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:16.965896 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:16.965899 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:16.965919 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:16.967500 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.967963 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.967966 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.967967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.968043 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:16.968320 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:16.968322 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:16.968323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:16.968500 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:16.968576 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:16.968895 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 05:08:16.969011 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":282,"thread_start_us":135,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.49.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.252.keytab.
Entry for principal kudu/127.22.49.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.252.keytab.
I20260811 05:08:16.969255 15385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.958286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:33215 (local address 127.0.0.1:44202)
0811 05:08:16.958413 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.958426 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:16.958508 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:16.959018 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:16.959024 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:16.959322 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:16.959450 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:16.959462 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.960622 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.960625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:16.961960 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:16.961971 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:16.962568 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:16.962572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:16.962707 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:16.963217 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:16.963232 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:16.965732 (+ 2500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:16.967650 (+ 1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:16.967653 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:16.967654 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:16.967871 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:16.968137 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:16.968140 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:16.968141 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:16.968238 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:16.968589 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:16.968591 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:16.968723 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 05:08:16.968839 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 05:08:16.968957 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":45}
I20260811 05:08:16.970026 15383 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:08:16.970250 22727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
/tmp/dist-test-taskvEfsDu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.252:46855
--webserver_interface=127.22.49.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.252.keytab
--principal=kudu/127.22.49.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.49.212:39445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.49.254:39843,127.22.49.253:33215,127.22.49.252:46855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 05:08:16.970723 15385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.970488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:46855 (local address 127.0.0.1:44032)
0811 05:08:16.970599 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.970673 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 05:08:16.970969 15318 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
I20260811 05:08:16.971935 15385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.971725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:46855 (local address 127.0.0.1:44036)
0811 05:08:16.971831 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.971890 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 05:08:16.972090 15383 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:46855: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
I20260811 05:08:16.996250 15292 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } attempt: 1
I20260811 05:08:16.997146 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.996840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:46855 (local address 127.0.0.1:44040)
0811 05:08:16.996996 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.997065 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 05:08:16.998003 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:16.997779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:46855 (local address 127.0.0.1:44050)
0811 05:08:16.997901 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:16.997948 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 05:08:16.998210 15292 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:46855: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
I20260811 05:08:17.021409 15383 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } attempt: 1
I20260811 05:08:17.022405 15385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.022089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:46855 (local address 127.0.0.1:44064)
0811 05:08:17.022259 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.022326 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 05:08:17.023267 15385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.023064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:46855 (local address 127.0.0.1:44074)
0811 05:08:17.023166 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.023213 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 05:08:17.023432 15383 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:46855: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
I20260811 05:08:17.073392 15292 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } attempt: 2
I20260811 05:08:17.074347 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.074035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:46855 (local address 127.0.0.1:44076)
0811 05:08:17.074202 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.074268 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 05:08:17.075152 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.074861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:46855 (local address 127.0.0.1:44088)
0811 05:08:17.075024 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.075082 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 05:08:17.075343 15292 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:46855: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
W20260811 05:08:17.087174 15391 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 05:08:17.087508 15391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 05:08:17.087566 15391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 05:08:17.087639 15391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 05:08:17.091642 15383 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } attempt: 2
W20260811 05:08:17.092234 15391 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 05:08:17.092296 15391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 05:08:17.092343 15391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 05:08:17.092375 15391 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 05:08:17.092398 15391 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 05:08:17.092622 15385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.092215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:46855 (local address 127.0.0.1:44100)
0811 05:08:17.092438 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.092529 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 05:08:17.093353 15385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.093131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:46855 (local address 127.0.0.1:44104)
0811 05:08:17.093239 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.093286 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 05:08:17.093494 15383 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.49.252:46855: Network error: Client connection negotiation failed: client connection to 127.22.49.252:46855: connect: Connection refused (error 111)
I20260811 05:08:17.098063 15391 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.49.212:39445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.49.254:39843,127.22.49.253:33215,127.22.49.252:46855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/krb5kdc/kudu_127.22.49.252.keytab
--principal=kudu/127.22.49.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.49.252:46855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.49.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 04:27:57 UTC on ccycloud.quasar-xvkbbt.root.comops.site
build id 4579723
I20260811 05:08:17.099179 15391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 05:08:17.100208 15391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 05:08:17.108732 15396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 05:08:17.108790 15401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:17.108923 15391 server_base.cc:1034] running on GCE node
W20260811 05:08:17.108760 15397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 05:08:17.109654 15391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 05:08:17.110700 15391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 05:08:17.111860 15391 hybrid_clock.cc:648] HybridClock initialized: now 1786424897111832 us; error 39 us; skew 500 ppm
Aug 11 05:08:17 dist-test-slave-w206 krb5kdc[15204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424897, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 05:08:17.114750 15391 init.cc:377] Logged in from keytab as kudu/127.22.49.252@KRBTEST.COM (short username kudu)
I20260811 05:08:17.115803 15391 webserver.cc:460] Webserver started at http://127.22.49.252:38137/ using document root <none> and password file <none>
I20260811 05:08:17.116391 15391 fs_manager.cc:359] Metadata directory not provided
I20260811 05:08:17.116485 15391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 05:08:17.116735 15391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 05:08:17.118831 15391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/data/instance:
uuid: "2cd27d05db0a4897b2f150722c621ab5"
format_stamp: "Formatted at 2026-08-11 05:08:17 on dist-test-slave-w206"
server_key: "3db7b9230cd99ae30c164bd9de8f43ed"
server_key_iv: "cca20c9c113667123f89dc5dc5cfa9a3"
server_key_version: "encryptionkey@0"
I20260811 05:08:17.119468 15391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/wal/instance:
uuid: "2cd27d05db0a4897b2f150722c621ab5"
format_stamp: "Formatted at 2026-08-11 05:08:17 on dist-test-slave-w206"
server_key: "3db7b9230cd99ae30c164bd9de8f43ed"
server_key_iv: "cca20c9c113667123f89dc5dc5cfa9a3"
server_key_version: "encryptionkey@0"
I20260811 05:08:17.123513 15391 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 05:08:17.126073 15409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 05:08:17.127511 15391 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 05:08:17.127651 15391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/data,/tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/wal
uuid: "2cd27d05db0a4897b2f150722c621ab5"
format_stamp: "Formatted at 2026-08-11 05:08:17 on dist-test-slave-w206"
server_key: "3db7b9230cd99ae30c164bd9de8f43ed"
server_key_iv: "cca20c9c113667123f89dc5dc5cfa9a3"
server_key_version: "encryptionkey@0"
I20260811 05:08:17.127777 15391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 05:08:17.146651 15391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 05:08:17.149976 15391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 05:08:17.150214 15391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 05:08:17.157452 15391 rpc_server.cc:307] RPC server started. Bound to: 127.22.49.252:46855
I20260811 05:08:17.157765 15470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.49.252:46855 every 8 connection(s)
I20260811 05:08:17.158609 15391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/data/info.pb
I20260811 05:08:17.161662 15471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 05:08:17.165609 15471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:08:17.168107 22727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu as pid 15391
I20260811 05:08:17.168248 22727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvEfsDu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786424592714304-22727-0/minicluster-data/master-2/wal/instance
I20260811 05:08:17.168589 22727 external_mini_cluster.cc:1428] Setting key 179d930926f3b0c9263c61f3f4a569c7
I20260811 05:08:17.174547 15292 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } attempt: 3
Aug 11 05:08:17 dist-test-slave-w206 krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424897, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.252@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
Aug 11 05:08:17 dist-test-slave-w206 krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.252@KRBTEST.COM
I20260811 05:08:17.180898 15295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.167658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54644 (local address 127.22.49.254:39843)
0811 05:08:17.167821 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.167825 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.168931 (+ 1106us) server_negotiation.cc:407] Connection header received
0811 05:08:17.170194 (+ 1263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.170198 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.170265 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.170354 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.171320 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.171822 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.172867 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.173085 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.173198 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.176384 (+ 3186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:17.176388 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:17.176391 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:17.176420 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:17.178361 (+ 1941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.178914 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.178916 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.178918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.179039 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.179440 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.179443 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.179445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.179689 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:17.179760 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:17.180575 (+ 815us) server_negotiation.cc:299] Negotiation successful
0811 05:08:17.180695 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 05:08:17 dist-test-slave-w206 krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.254@KRBTEST.COM for kudu/127.22.49.252@KRBTEST.COM
I20260811 05:08:17.182852 15473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.168115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.254:39843 (local address 127.0.0.1:54644)
0811 05:08:17.168765 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.168812 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:17.169977 (+ 1165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:17.170423 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:17.170429 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:17.170798 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:17.171175 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.171190 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.171949 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.171953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.172717 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.172725 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.173243 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.173247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.173523 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.174187 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:17.174210 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:17.176244 (+ 2034us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:17.178462 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:17.178472 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:17.178491 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:17.178809 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:17.179140 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:17.179143 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:17.179145 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:17.179303 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:17.179861 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:17.179869 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:17.180254 (+ 385us) client_negotiation.cc:769] Sending connection context
0811 05:08:17.181118 (+ 864us) client_negotiation.cc:240] Negotiation successful
0811 05:08:17.181498 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"mutex_wait_us":50,"thread_start_us":210,"threads_started":1}
I20260811 05:08:17.182904 15475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.169261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44114 (local address 127.22.49.252:46855)
0811 05:08:17.169620 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.169631 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.169667 (+ 36us) server_negotiation.cc:407] Connection header received
0811 05:08:17.169980 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.170002 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.170201 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.170401 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.171374 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.172250 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.173091 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.173554 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.173675 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.177183 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:17.177191 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:17.177206 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:17.177245 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:17.179993 (+ 2748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.180504 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.180511 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.180513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.180612 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.180945 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.180948 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.180950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.181294 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:17.181517 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:17.182482 (+ 965us) server_negotiation.cc:299] Negotiation successful
0811 05:08:17.182651 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":83,"server-negotiator.queue_time_us":266,"thread_start_us":108,"threads_started":1}
I20260811 05:08:17.184645 15383 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } attempt: 3
I20260811 05:08:17.184787 15471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:08:17.187186 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.175110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:46855 (local address 127.0.0.1:44124)
0811 05:08:17.175306 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.175322 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:17.175403 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:17.176514 (+ 1111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:17.176518 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:17.176774 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:17.176905 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.176914 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.177986 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.177990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.178722 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.178729 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.179411 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.179418 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.179512 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.180005 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:17.180019 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:17.181553 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:17.183925 (+ 2372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:17.183930 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:17.183932 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:17.184209 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:17.185884 (+ 1675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:17.185888 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:17.185890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:17.186002 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:17.186582 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:17.186586 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:17.186701 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 05:08:17.186802 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 05:08:17.186956 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260811 05:08:17.187960 15477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.175147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44124 (local address 127.22.49.252:46855)
0811 05:08:17.176167 (+ 1020us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.176181 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.176198 (+ 17us) server_negotiation.cc:407] Connection header received
0811 05:08:17.176309 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.176314 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.176371 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.176488 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.177065 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.177855 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.178835 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.179267 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.179397 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.181697 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:17.181702 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:17.181705 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:17.181731 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:17.183794 (+ 2063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.184447 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.184449 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.184450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.184535 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.186145 (+ 1610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.186150 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.186152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.186449 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:17.187497 (+ 1048us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:17.187594 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 05:08:17.187736 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":910,"thread_start_us":101,"threads_started":1}
Aug 11 05:08:17 dist-test-slave-w206 krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.253@KRBTEST.COM for kudu/127.22.49.252@KRBTEST.COM
I20260811 05:08:17.191543 15292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85: Bootstrap starting.
Aug 11 05:08:17 dist-test-slave-w206 krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.254@KRBTEST.COM
I20260811 05:08:17.194890 15292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:17.195773 15385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.185165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:46855 (local address 127.0.0.1:44138)
0811 05:08:17.185390 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.185425 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:17.185518 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:17.185831 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:17.185834 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:17.186010 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:17.186093 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.186098 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.187203 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.187206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.188071 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.188084 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.188735 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.188739 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.188826 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.189406 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:17.189421 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:17.191358 (+ 1937us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:17.193180 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:17.193183 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:17.193186 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:17.193396 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:17.193674 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:17.193677 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:17.193679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:17.193780 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:17.195207 (+ 1427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:17.195210 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:17.195329 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 05:08:17.195442 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 05:08:17.195610 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139}
I20260811 05:08:17.195850 15475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.185194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44138 (local address 127.22.49.252:46855)
0811 05:08:17.185633 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.185636 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.185650 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:08:17.185679 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.185681 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.185722 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.185806 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.186240 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.187065 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.188220 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.188604 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.189063 (+ 459us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.191532 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:17.191539 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:17.191542 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:17.191570 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:17.193057 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.193492 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.193497 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.193498 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.193582 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.194754 (+ 1172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.194760 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.194765 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.195100 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:17.195236 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:17.195525 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 05:08:17.195654 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":42}
I20260811 05:08:17.195915 15292 log.cc:824] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:17.197630 15295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.185675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54646 (local address 127.22.49.254:39843)
0811 05:08:17.185790 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.185794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.186183 (+ 389us) server_negotiation.cc:407] Connection header received
0811 05:08:17.186298 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.186302 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.186355 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.186425 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.187254 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.188042 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.189169 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.189589 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.189689 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.192672 (+ 2983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:17.192676 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:17.192679 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:17.192707 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:17.194589 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.195135 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.195139 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.195141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.195232 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.195569 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.195574 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.195576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.195778 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:17.197023 (+ 1245us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:17.197245 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 05:08:17.197379 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 05:08:17.198236 15292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85: No bootstrap required, opened a new log
I20260811 05:08:17.199908 15383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb: Bootstrap starting.
I20260811 05:08:17.203060 15383 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:17.203568 15292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } }
I20260811 05:08:17.203852 15292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fdeddfa5e504bc9aed7642b5b48cf85, State: Initialized, Role: FOLLOWER
I20260811 05:08:17.204023 15383 log.cc:824] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb: Log is configured to *not* fsync() on all Append() calls
Aug 11 05:08:17 dist-test-slave-w206 krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.49.253@KRBTEST.COM
I20260811 05:08:17.204216 15292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } }
I20260811 05:08:17.204739 15480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } } }
I20260811 05:08:17.204902 15480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [sys.catalog]: This master's current role is: FOLLOWER
Aug 11 05:08:17 dist-test-slave-w206 krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424897, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.252@KRBTEST.COM for kudu/127.22.49.253@KRBTEST.COM
I20260811 05:08:17.205704 15292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:17.207103 15383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb: No bootstrap required, opened a new log
I20260811 05:08:17.209569 15473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.185247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.253:33215 (local address 127.0.0.1:44212)
0811 05:08:17.185482 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.185496 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:17.185578 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:17.186345 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:17.186348 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:17.186534 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:17.186656 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.186663 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.187987 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.187991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.196592 (+ 8601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.196602 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.200691 (+ 4089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.200696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.200841 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.203141 (+ 2300us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:17.203159 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:17.205325 (+ 2166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:17.207857 (+ 2532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:17.207861 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:17.207863 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:17.208128 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:17.208457 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:17.208460 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:17.208462 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:17.208553 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:17.209027 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:17.209030 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:17.209130 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 05:08:17.209233 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 05:08:17.209389 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":26}
I20260811 05:08:17.210304 15389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.185486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44212 (local address 127.22.49.253:33215)
0811 05:08:17.185680 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.185684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.185700 (+ 16us) server_negotiation.cc:407] Connection header received
0811 05:08:17.185753 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.185756 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.185802 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.185883 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.186821 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.187566 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.196730 (+ 9164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.197100 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.197230 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.205517 (+ 8287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:17.205522 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:17.205525 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:17.205553 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:17.207709 (+ 2156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.208251 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.208255 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.208256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.208349 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.208655 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.208658 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.208660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.208887 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:17.208978 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:17.210014 (+ 1036us) server_negotiation.cc:299] Negotiation successful
0811 05:08:17.210144 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260811 05:08:17.211182 15471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } has no permanent_uuid. Determining permanent_uuid...
I20260811 05:08:17.211593 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.198848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44228 (local address 127.22.49.253:33215)
0811 05:08:17.198963 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.198968 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.199050 (+ 82us) server_negotiation.cc:407] Connection header received
0811 05:08:17.199174 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.199177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.199220 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.199313 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.199938 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.200533 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.201530 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.201851 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.201956 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.205525 (+ 3569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:17.205529 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:17.205532 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:17.205596 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:17.208658 (+ 3062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.209412 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.209415 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.209417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.209518 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.210016 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.210020 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.210022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.210271 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:17.210457 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:17.211295 (+ 838us) server_negotiation.cc:299] Negotiation successful
0811 05:08:17.211428 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45,"spinlock_wait_cycles":19200}
I20260811 05:08:17.211405 15383 raft_consensus.cc:348] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } }
I20260811 05:08:17.211905 15383 raft_consensus.cc:729] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 210a2909ddb94ccc9f800acab9b069bb, State: Initialized, Role: FOLLOWER
I20260811 05:08:17.212257 15383 consensus_queue.cc:260] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } }
I20260811 05:08:17.213658 15383 sys_catalog.cc:564] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb [sys.catalog]: configured and running, proceeding with master startup.
W20260811 05:08:17.215651 15493 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:08:17.215752 15493 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:08:17.212359 15219 master_runner.cc:186] Error getting master registration for 127.22.49.253:33215: OK, instance_id { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" instance_seqno: 1786424896927525 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 05:08:17.216651 15219 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 11 05:08:17 dist-test-slave-w206 krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786424897, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.49.252@KRBTEST.COM for kudu/127.22.49.252@KRBTEST.COM
I20260811 05:08:17.220067 22727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 05:08:17.221304 15262 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54646
I20260811 05:08:17.221537 15262 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 05:08:17.221665 15262 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:17.222082 15475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.211680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44146 (local address 127.22.49.252:46855)
0811 05:08:17.211786 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.211791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.212263 (+ 472us) server_negotiation.cc:407] Connection header received
0811 05:08:17.212294 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.212296 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.212335 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.212421 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.212989 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.213671 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.214811 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.215169 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.215280 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.217789 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:17.217792 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:17.217795 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:17.217819 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:17.219602 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.220106 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.220111 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.220115 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.220201 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.220604 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.220608 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.220609 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.220820 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:17.220912 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:17.221675 (+ 763us) server_negotiation.cc:299] Negotiation successful
0811 05:08:17.221845 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 05:08:17.222492 15473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.211662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.49.252:46855 (local address 127.0.0.1:44146)
0811 05:08:17.212070 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0811 05:08:17.212085 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 05:08:17.212164 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 05:08:17.212604 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 05:08:17.212607 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 05:08:17.212775 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 05:08:17.212874 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.212881 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.213839 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.213842 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.214683 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 05:08:17.214694 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.215403 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.215410 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 05:08:17.215505 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.216154 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 05:08:17.216172 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 05:08:17.217654 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 05:08:17.219709 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:17.219716 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:17.219718 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:17.220002 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:17.220406 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 05:08:17.220409 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 05:08:17.220411 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 05:08:17.220498 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 05:08:17.220946 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 05:08:17.220949 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 05:08:17.221054 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 05:08:17.221155 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 05:08:17.221304 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343}
I20260811 05:08:17.223289 15262 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } }
I20260811 05:08:17.224792 15355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "210a2909ddb94ccc9f800acab9b069bb"
I20260811 05:08:17.225059 15355 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:17.222093 15299 master_runner.cc:186] Error getting master registration for 127.22.49.252:46855: OK, instance_id { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" instance_seqno: 1786424897155455 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 05:08:17.225657 15299 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 05:08:17.226320 15510 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 05:08:17.226361 15355 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdeddfa5e504bc9aed7642b5b48cf85 in term 1.
W20260811 05:08:17.226619 15510 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:08:17.226858 15236 leader_election.cc:302] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdeddfa5e504bc9aed7642b5b48cf85, 210a2909ddb94ccc9f800acab9b069bb; no voters:
I20260811 05:08:17.226850 15494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } } }
I20260811 05:08:17.226977 15494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:17.227159 15480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 05:08:17.227459 15480 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [term 1 LEADER]: Becoming Leader. State: Replica: 1fdeddfa5e504bc9aed7642b5b48cf85, State: Running, Role: LEADER
I20260811 05:08:17.227806 15480 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } }
I20260811 05:08:17.229112 15471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5: Bootstrap starting.
I20260811 05:08:17.230103 15512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fdeddfa5e504bc9aed7642b5b48cf85. Latest consensus state: current_term: 1 leader_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } } }
I20260811 05:08:17.230304 15512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:17.231354 15262 leader_election.cc:288] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [CANDIDATE]: Term 1 election: Requested vote from peers 210a2909ddb94ccc9f800acab9b069bb (127.22.49.253:33215), 2cd27d05db0a4897b2f150722c621ab5 (127.22.49.252:46855)
I20260811 05:08:17.232259 15515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 05:08:17.234120 15515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 05:08:17.235734 15471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5: Neither blocks nor log segments found. Creating new log.
I20260811 05:08:17.237212 15471 log.cc:824] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5: Log is configured to *not* fsync() on all Append() calls
I20260811 05:08:17.249359 15471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5: No bootstrap required, opened a new log
I20260811 05:08:17.250013 15355 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb [term 1 FOLLOWER]: Refusing update from remote peer 1fdeddfa5e504bc9aed7642b5b48cf85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:17.250809 15512 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:17.252161 15295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.238314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54654 (local address 127.22.49.254:39843)
0811 05:08:17.238435 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.238439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.241305 (+ 2866us) server_negotiation.cc:407] Connection header received
0811 05:08:17.241885 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.241889 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.241946 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.242004 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.243218 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.244057 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.245305 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.245641 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.245733 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.247829 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:17.247834 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:17.247837 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:17.247865 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:17.249699 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.250461 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.250465 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.250468 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.250565 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.250919 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.250922 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.250924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.251183 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:17.251311 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:17.251850 (+ 539us) server_negotiation.cc:299] Negotiation successful
0811 05:08:17.251980 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 05:08:17.254004 15471 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } }
I20260811 05:08:17.254308 15471 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd27d05db0a4897b2f150722c621ab5, State: Initialized, Role: FOLLOWER
I20260811 05:08:17.254706 15471 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } }
I20260811 05:08:17.254741 15494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fdeddfa5e504bc9aed7642b5b48cf85. Latest consensus state: current_term: 1 leader_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } } }
I20260811 05:08:17.254866 15494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:17.256170 15471 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 05:08:17.256247 15442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2cd27d05db0a4897b2f150722c621ab5"
I20260811 05:08:17.256485 15442 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 05:08:17.258311 15442 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdeddfa5e504bc9aed7642b5b48cf85 in term 1.
I20260811 05:08:17.259208 15441 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5 [term 1 FOLLOWER]: Refusing update from remote peer 1fdeddfa5e504bc9aed7642b5b48cf85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 05:08:17.262262 15512 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 05:08:17.264264 15475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.240567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44148 (local address 127.22.49.252:46855)
0811 05:08:17.240689 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.240694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.253081 (+ 12387us) server_negotiation.cc:407] Connection header received
0811 05:08:17.253281 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.253285 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.253337 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.253395 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.254498 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.255238 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.256825 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.257185 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.257287 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.259488 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:17.259493 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:17.259496 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:17.259527 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:17.261447 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.262011 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.262015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.262017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.262118 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.263142 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.263146 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.263148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.263446 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:17.263561 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:17.263963 (+ 402us) server_negotiation.cc:299] Negotiation successful
0811 05:08:17.264094 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 05:08:17.267194 15527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } } }
I20260811 05:08:17.267445 15527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:17.267551 15527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fdeddfa5e504bc9aed7642b5b48cf85. Latest consensus state: current_term: 1 leader_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } } }
I20260811 05:08:17.267647 15527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 05:08:17.267940 15538 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 05:08:17.268021 15538 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 05:08:17.280580 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:17.239382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44242 (local address 127.22.49.253:33215)
0811 05:08:17.239499 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.239503 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.241693 (+ 2190us) server_negotiation.cc:407] Connection header received
0811 05:08:17.241828 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.241831 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.241897 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.241980 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.245440 (+ 3460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.246203 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.267771 (+ 21568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:17.268201 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:17.268279 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:17.272534 (+ 4255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 05:08:17.272538 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 05:08:17.272541 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 05:08:17.272572 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 05:08:17.274331 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.277989 (+ 3658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.277993 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.277995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.278092 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 05:08:17.279517 (+ 1425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 05:08:17.279520 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 05:08:17.279522 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 05:08:17.279756 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 05:08:17.279869 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:17.280260 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 05:08:17.280413 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 05:08:17.283919 15480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } } }
I20260811 05:08:17.284090 15480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:17.284471 15523 mvcc.cc:205] Tried to move back new op lower bound from 7317196379113906176 to 7317196379048869888. Current Snapshot: MvccSnapshot[applied={T|T < 7317196379113906176}]
I20260811 05:08:17.284655 15540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } } }
I20260811 05:08:17.284806 15540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:17.285701 15512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } } }
I20260811 05:08:17.285847 15512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85 [sys.catalog]: This master's current role is: LEADER
I20260811 05:08:17.286952 15494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdeddfa5e504bc9aed7642b5b48cf85" member_type: VOTER last_known_addr { host: "127.22.49.254" port: 39843 } } peers { permanent_uuid: "210a2909ddb94ccc9f800acab9b069bb" member_type: VOTER last_known_addr { host: "127.22.49.253" port: 33215 } } peers { permanent_uuid: "2cd27d05db0a4897b2f150722c621ab5" member_type: VOTER last_known_addr { host: "127.22.49.252" port: 46855 } } }
I20260811 05:08:17.287093 15494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb [sys.catalog]: This master's current role is: FOLLOWER
I20260811 05:08:17.287834 15541 mvcc.cc:205] Tried to move back new op lower bound from 7317196379113906176 to 7317196379048869888. Current Snapshot: MvccSnapshot[applied={T|T < 7317196379113906176}]
I20260811 05:08:17.288002 15525 mvcc.cc:205] Tried to move back new op lower bound from 7317196379113906176 to 7317196379048869888. Current Snapshot: MvccSnapshot[applied={T|T < 7317196379113906176}]
I20260811 05:08:17.296649 15515 catalog_manager.cc:1347] Generated new cluster ID: 0ef5d0b26c8b4abc91f1823a8612a77a
I20260811 05:08:17.296753 15515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 05:08:17.323745 15515 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 05:08:17.325232 15515 catalog_manager.cc:1504] Loading token signing keys...
I20260811 05:08:17.347047 15515 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1fdeddfa5e504bc9aed7642b5b48cf85: Generated new TSK 0
I20260811 05:08:17.348105 15515 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 05:08:17.397823 15295 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.395596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54660 (local address 127.22.49.254:39843)
0811 05:08:17.395746 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.395751 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.396415 (+ 664us) server_negotiation.cc:407] Connection header received
0811 05:08:17.396742 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.396746 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.396806 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.396905 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.397671 (+ 766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54660: BlockingRecv error: recv got EOF from 127.0.0.1:54660 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260811 05:08:17.397990 15387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.396098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44256 (local address 127.22.49.253:33215)
0811 05:08:17.396212 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.396216 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.396943 (+ 727us) server_negotiation.cc:407] Connection header received
0811 05:08:17.397131 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.397134 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.397184 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.397246 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.397862 (+ 616us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44256: BlockingRecv error: recv got EOF from 127.0.0.1:44256 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 05:08:17.399420 15475 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.396546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44164 (local address 127.22.49.252:46855)
0811 05:08:17.396666 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.396670 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.398370 (+ 1700us) server_negotiation.cc:407] Connection header received
0811 05:08:17.398561 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.398564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.398616 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.398672 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.399232 (+ 560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44164: BlockingRecv error: recv got EOF from 127.0.0.1:44164 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260811 05:08:17.415127 15387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.408127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44270 (local address 127.22.49.253:33215)
0811 05:08:17.408251 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.408256 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.413828 (+ 5572us) server_negotiation.cc:407] Connection header received
0811 05:08:17.414113 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.414118 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.414203 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.414257 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.414950 (+ 693us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44270: BlockingRecv error: recv got EOF from 127.0.0.1:44270 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 05:08:17.432431 15387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.427268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44274 (local address 127.22.49.253:33215)
0811 05:08:17.427387 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.427392 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.431337 (+ 3945us) server_negotiation.cc:407] Connection header received
0811 05:08:17.431581 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.431585 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.431644 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.431698 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.432306 (+ 608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44274: BlockingRecv error: recv got EOF from 127.0.0.1:44274 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260811 05:08:17.448972 15387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.447322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44282 (local address 127.22.49.253:33215)
0811 05:08:17.447448 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.447453 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.447997 (+ 544us) server_negotiation.cc:407] Connection header received
0811 05:08:17.448131 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.448134 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.448196 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.448287 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.448841 (+ 554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44282: BlockingRecv error: recv got EOF from 127.0.0.1:44282 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 05:08:17.457271 15387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.455508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44284 (local address 127.22.49.253:33215)
0811 05:08:17.455663 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.455669 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.456391 (+ 722us) server_negotiation.cc:407] Connection header received
0811 05:08:17.456456 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.456461 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.456517 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.456605 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.457153 (+ 548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44284: BlockingRecv error: recv got EOF from 127.0.0.1:44284 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260811 05:08:17.473616 15387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.471514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44286 (local address 127.22.49.253:33215)
0811 05:08:17.472547 (+ 1033us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.472553 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.472572 (+ 19us) server_negotiation.cc:407] Connection header received
0811 05:08:17.472638 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.472645 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.472724 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.472820 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.473480 (+ 660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44286: BlockingRecv error: recv got EOF from 127.0.0.1:44286 (error 108)
Metrics: {"server-negotiator.queue_time_us":928}
W20260811 05:08:17.494445 15387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.492822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44300 (local address 127.22.49.253:33215)
0811 05:08:17.492988 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.492994 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.493455 (+ 461us) server_negotiation.cc:407] Connection header received
0811 05:08:17.493604 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.493608 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.493677 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.493793 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.494290 (+ 497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44300: BlockingRecv error: recv got EOF from 127.0.0.1:44300 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260811 05:08:17.530166 15387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.529105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44304 (local address 127.22.49.253:33215)
0811 05:08:17.529274 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.529278 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.529373 (+ 95us) server_negotiation.cc:407] Connection header received
0811 05:08:17.529497 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.529500 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.529550 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.529635 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.530061 (+ 426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44304: BlockingRecv error: recv got EOF from 127.0.0.1:44304 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260811 05:08:17.597852 15387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.596555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44320 (local address 127.22.49.253:33215)
0811 05:08:17.596728 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.596733 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.596864 (+ 131us) server_negotiation.cc:407] Connection header received
0811 05:08:17.597074 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.597078 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.597139 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.597239 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.597722 (+ 483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44320: BlockingRecv error: recv got EOF from 127.0.0.1:44320 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260811 05:08:17.729460 15387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.728135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44332 (local address 127.22.49.253:33215)
0811 05:08:17.728388 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.728393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.728499 (+ 106us) server_negotiation.cc:407] Connection header received
0811 05:08:17.728623 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.728626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.728684 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.728780 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.729293 (+ 513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44332: BlockingRecv error: recv got EOF from 127.0.0.1:44332 (error 108)
Metrics: {"server-negotiator.queue_time_us":123}
W20260811 05:08:17.989185 15387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 05:08:17.987960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44336 (local address 127.22.49.253:33215)
0811 05:08:17.988104 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:17.988108 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:17.988183 (+ 75us) server_negotiation.cc:407] Connection header received
0811 05:08:17.988314 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:17.988317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:17.988368 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:17.988451 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 05:08:17.989054 (+ 603us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44336: BlockingRecv error: recv got EOF from 127.0.0.1:44336 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 05:08:18.228458 15510 catalog_manager.cc:1259] Loaded cluster ID: 0ef5d0b26c8b4abc91f1823a8612a77a
I20260811 05:08:18.228588 15510 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb: loading cluster ID for follower catalog manager: success
I20260811 05:08:18.230438 15510 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb: acquiring CA information for follower catalog manager: success
I20260811 05:08:18.232544 15510 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 210a2909ddb94ccc9f800acab9b069bb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 05:08:18.269389 15538 catalog_manager.cc:1259] Loaded cluster ID: 0ef5d0b26c8b4abc91f1823a8612a77a
I20260811 05:08:18.269474 15538 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5: loading cluster ID for follower catalog manager: success
I20260811 05:08:18.271323 15538 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5: acquiring CA information for follower catalog manager: success
I20260811 05:08:18.272478 15538 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2cd27d05db0a4897b2f150722c621ab5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 05:08:18.507989 15618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:18.503564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44342 (local address 127.22.49.253:33215)
0811 05:08:18.503860 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:18.503864 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:18.503962 (+ 98us) server_negotiation.cc:407] Connection header received
0811 05:08:18.504065 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:18.504068 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:18.504202 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:18.504356 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:18.504608 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.505127 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.506177 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.506492 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.506580 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:18.506961 (+ 381us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:18.507490 (+ 529us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:18.507586 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:18.507731 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 05:08:18.507786 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":108,"threads_started":1}
I20260811 05:08:18.515281 15625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:18.511161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44172 (local address 127.22.49.252:46855)
0811 05:08:18.511459 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:18.511463 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:18.511477 (+ 14us) server_negotiation.cc:407] Connection header received
0811 05:08:18.511565 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:18.511567 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:18.511710 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:18.511846 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:18.512085 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.512632 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.513565 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.513803 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.513926 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:18.514253 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:18.514844 (+ 591us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:18.515016 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:18.515056 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 05:08:18.515116 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":149,"threads_started":1}
I20260811 05:08:18.523051 15625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:18.518601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44184 (local address 127.22.49.252:46855)
0811 05:08:18.518744 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:18.518748 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:18.519279 (+ 531us) server_negotiation.cc:407] Connection header received
0811 05:08:18.519465 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:18.519468 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:18.519517 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:18.519563 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:18.519955 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.520469 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.521902 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.522133 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.522251 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:18.522510 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:18.522591 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:18.522674 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:18.522833 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 05:08:18.522891 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 05:08:18.523237 15618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:18.518990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44354 (local address 127.22.49.253:33215)
0811 05:08:18.519125 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:18.519132 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:18.519250 (+ 118us) server_negotiation.cc:407] Connection header received
0811 05:08:18.519378 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:18.519382 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:18.519433 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:18.519512 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:18.519794 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.520634 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.521863 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.522190 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.522278 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:18.522698 (+ 420us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:18.522789 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:18.522854 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:18.523034 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 05:08:18.523103 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 05:08:18.523777 15632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 05:08:18.518482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54676 (local address 127.22.49.254:39843)
0811 05:08:18.518855 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0811 05:08:18.518859 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 05:08:18.519185 (+ 326us) server_negotiation.cc:407] Connection header received
0811 05:08:18.519403 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 05:08:18.519408 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 05:08:18.519591 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 05:08:18.519717 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 05:08:18.520007 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.520805 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.521770 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 05:08:18.522124 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 05:08:18.522240 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 05:08:18.522794 (+ 554us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 05:08:18.523383 (+ 589us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 05:08:18.523479 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 05:08:18.523575 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 05:08:18.523637 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":65,"threads_started":1}
I20260811 05:08:18.527154 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 15219
I20260811 05:08:18.536722 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 15299
I20260811 05:08:18.545238 22727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvEfsDu/build/debug/bin/kudu with pid 15391
2026-08-11T05:08:18Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3270 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6456 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (305790 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST